Skip to main content
Ctrl+K
Logo image Logo image

Qserv

Site Navigation

  • Introduction
  • Administrator’s Guide
  • User’s Guide
  • Ingesting catalogs
  • Developer’s Guide
  • Rubin docs

Site Navigation

  • Introduction
  • Administrator’s Guide
  • User’s Guide
  • Ingesting catalogs
  • Developer’s Guide
  • Rubin docs

Section Navigation

  • Introduction
  • The Ingest Workflow Developer’s Guide
    • Introduction
    • Main concepts
      • Overview of the ingest workflow
      • Types of tables in Qserv
      • Transactions
      • Table contributions
      • Publishing databases and tables
      • Database families
    • Simple Workflow Example
    • Advanced Scenarios
      • Global configuration options
      • Character sets in contributions
      • Concurrency control when processing async requests
      • Ingesting tables into the published catalogs
      • Transaction management
      • Optimizations in using the REST services
      • Options for making contribution requests
      • Databases with many director tables
      • Ingesting ref-match tables
      • Using MySQL warnings for the data quality control
    • Post-Ingest Data Management Tasks
    • Ingest API Reference
      • REST Services
        • General guidelines
        • Master Replication Controller
        • Worker Ingest Server
      • The Command Line Tools
  • The Kubernetes-based Ingest Workflow
    • Set up ingest input data
    • The version history of the Ingest Workflow
    • Run Qserv ingest on a Kubernetes cluster
    • How to use replication service client
    • About integration test cases
  • Data preparation
    • Introduction
    • Partitioning
    • Partitioner
    • Partitioning data of the ref-match tables

Data preparation¶

  • Introduction
    • Data conversion
    • Partitioning
    • Post-processing
    • Handling the binary data
    • Restrictions for the variable-length column types
    • Staging
  • Partitioning
    • Overview
    • The Partitioning Scheme
    • Partition Identifiers
    • Overlap
    • Match Tables
    • Object movement
  • Partitioner
    • Summary
    • Requirements
    • Design
    • Usage
  • Partitioning data of the ref-match tables
    • Introduction
    • The spatial match within the given overlap radius
    • Partitioning using index maps

previous

About integration test cases

next

Introduction

Edit this page

© Copyright 2015-2024 Association of Universities for Research in Astronomy, Inc. (AURA).

Built with the PyData Sphinx Theme 0.12.0.

Created using Sphinx 8.1.3.