Skip to main content
Ctrl+K
Logo image Logo image

Qserv

Site Navigation

  • Introduction
  • Administrator’s Guide
  • User’s Guide
  • Ingesting catalogs
  • Developer’s Guide
  • Rubin docs

Site Navigation

  • Introduction
  • Administrator’s Guide
  • User’s Guide
  • Ingesting catalogs
  • Developer’s Guide
  • Rubin docs

Section Navigation

  • Introduction
  • The Ingest Workflow Developer’s Guide
    • Introduction
    • Main concepts
      • Overview of the ingest workflow
      • Types of tables in Qserv
      • Transactions
      • Table contributions
      • Publishing databases and tables
      • Database families
    • Simple Workflow Example
    • Advanced Scenarios
      • Global configuration options
      • Character sets in contributions
      • Concurrency control when processing async requests
      • Ingesting tables into the published catalogs
      • Transaction management
      • Optimizations in using the REST services
      • Options for making contribution requests
      • Databases with many director tables
      • Ingesting ref-match tables
      • Using MySQL warnings for the data quality control
    • Post-Ingest Data Management Tasks
    • Ingest API Reference
      • REST Services
        • General guidelines
        • Master Replication Controller
        • Worker Ingest Server
      • The Command Line Tools
  • The Kubernetes-based Ingest Workflow
    • Set up ingest input data
    • The version history of the Ingest Workflow
    • Run Qserv ingest on a Kubernetes cluster
    • How to use replication service client
    • About integration test cases
  • Data preparation
    • Introduction
    • Partitioning
    • Partitioner
    • Partitioning data of the ref-match tables

Post-Ingest Data Management Tasks#

The following optional steps are performed after the data has been ingested:

  • Row counters optimization (ADMIN)

  • Data Table Indexes (ADMIN)

  • Director Index (ADMIN)

previous

Using MySQL warnings for the data quality control

next

Ingest API Reference
Edit this page

© Copyright 2015-2024 Association of Universities for Research in Astronomy, Inc. (AURA).

Built with the PyData Sphinx Theme 0.12.0.

Created using Sphinx 6.2.1.