Skip to main content

Data Sources

As part of DataGyro’s Search vertical, a data source is exactly what it sounds like - a source of your data that you can connect to. Important: Data sources are not directly queryable - they serve as the foundation for creating collections, which you can then query.

Currently Supported Data Sources

DataGyro currently supports the following data sources:

SQL Databases

  • PostgreSQL - Connect to your PostgreSQL databases
  • MySQL - Connect to your MySQL databases
  • Other database platforms coming soon

SQL Dumps

  • Import data from SQL dump files
  • Other file formats coming soon
We’re actively working on expanding our supported data sources. Additional database types, document formats (PDF, Word), unstructured data sources, and file formats (JSON, Parquet, CSV) will be available in upcoming releases.

Connecting a SQL Database

To connect a PostgreSQL or MySQL database:
  1. Navigate to the “Data Sources” section in your project
  2. Click “Add New Data Source”
  3. Select “PostgreSQL” or “MySQL” as your database type
  4. Enter your database connection string in the standard format:
    postgresql://username:password@hostname:port/database
    
    or
    mysql://username:password@hostname:port/database
    
  5. Click “Test Connection” to verify the connection works
  6. Save your data source
The connection string contains all the necessary information to connect to your database in a single line, including username, password, host, port, and database name. Remember that after creating a data source, you’ll need to create a collection from it before you can query your data.

Importing SQL Dump Files

To import data from a SQL dump file:
  1. Navigate to the “Data Sources” section
  2. Click “Add New Data Source”
  3. Select “SQL Dump” as your source type
  4. Upload your SQL dump file
    • Maximum file size: 5GB
    • Supported formats: .sql files
  5. Specify any import options
  6. Click “Import” to begin the process
  7. Wait for the import to complete
  8. Save your data source
If your file upload fails, you’ll have the option to retry by editing the data source.

Managing Your Data Sources

Viewing Data Source Details

To view details about an existing data source:
  1. Go to the “Data Sources” section
  2. Click on the name of the data source you want to view
  3. Review connection details, tables/views, and status

Editing a Data Source

Data sources can only be edited in specific situations:
  1. When a file upload has failed and needs to be retried
  2. Go to the “Data Sources” section
  3. Find the data source with the failed upload
  4. Click the “Edit” button
  5. Fix any issues with the file or upload settings
  6. Retry the upload process
For database connections, if you need to change connection details, you’ll need to create a new data source rather than editing an existing one.

Deleting a Data Source

To delete a data source:
  1. Navigate to the “Data Sources” section
  2. Find the data source you want to delete
  3. Click the “Delete” button
  4. Confirm the deletion

Data Source vs. Collections

It’s important to understand the relationship between data sources and collections:
  • Data Sources: Define where and how to connect to your data. They provide access to the raw data but are not directly queryable.
  • Collections: Created from data sources, collections let you organize, define schemas, and ultimately query your data.
This separation provides several benefits:
  • Use a single data source to create multiple collections with different views of the data
  • Apply specific transformations or filters to each collection
  • Manage permissions at the collection level
  • Create optimized query interfaces for different use cases
Deleting a data source will remove all collections created from that data source. This action cannot be undone.

Data Source Security

DataGyro takes security seriously and implements several measures to protect your data source connections:
  • All connection credentials are encrypted at rest
  • SSL/TLS encryption for data in transit
  • Role-based access control for data sources
  • No storage of raw data - DataGyro only connects to your sources
  • Regular security audits and updates

Troubleshooting Connection Issues

If you’re having trouble connecting to a data source, check the following:
  1. Connection Details: Verify that hostname, port, database name, username, and password are correct
  2. Network Access: Ensure that your database server allows connections from DataGyro’s IP addresses
  3. Firewall Settings: Check if there are any firewall rules blocking the connection
  4. Database User Permissions: Verify that the user has appropriate SELECT privileges
  5. SSL Requirements: If your database requires SSL, ensure the SSL settings are properly configured

Upcoming Data Source Features

We’re actively working on expanding our data source capabilities. Coming soon:
  • Additional SQL database support (SQL Server, Oracle, SQLite)
  • Document integration (PDF, Word documents)
  • File-based data sources (JSON, CSV, Parquet, Excel)
  • Unstructured data support
  • No-code data import wizards
For persistent connection issues, contact our support team with the error details for assistance.