Data Sources
As part of DataGyro’s Search vertical, a data source is exactly what it sounds like - a source of your data that you can connect to. Important: Data sources are not directly queryable - they serve as the foundation for creating collections, which you can then query.Currently Supported Data Sources
DataGyro currently supports the following data sources:SQL Databases
- PostgreSQL - Connect to your PostgreSQL databases
- MySQL - Connect to your MySQL databases
- Other database platforms coming soon
SQL Dumps
- Import data from SQL dump files
- Other file formats coming soon
We’re actively working on expanding our supported data sources. Additional database types, document formats (PDF, Word), unstructured data sources, and file formats (JSON, Parquet, CSV) will be available in upcoming releases.
Connecting a SQL Database
To connect a PostgreSQL or MySQL database:- Navigate to the “Data Sources” section in your project
- Click “Add New Data Source”
- Select “PostgreSQL” or “MySQL” as your database type
- Enter your database connection string in the standard format:
or
- Click “Test Connection” to verify the connection works
- Save your data source
Importing SQL Dump Files
To import data from a SQL dump file:- Navigate to the “Data Sources” section
- Click “Add New Data Source”
- Select “SQL Dump” as your source type
- Upload your SQL dump file
- Maximum file size: 5GB
- Supported formats: .sql files
- Specify any import options
- Click “Import” to begin the process
- Wait for the import to complete
- Save your data source
Managing Your Data Sources
Viewing Data Source Details
To view details about an existing data source:- Go to the “Data Sources” section
- Click on the name of the data source you want to view
- Review connection details, tables/views, and status
Editing a Data Source
Data sources can only be edited in specific situations:- When a file upload has failed and needs to be retried
- Go to the “Data Sources” section
- Find the data source with the failed upload
- Click the “Edit” button
- Fix any issues with the file or upload settings
- Retry the upload process
For database connections, if you need to change connection details, you’ll need to create a new data source rather than editing an existing one.
Deleting a Data Source
To delete a data source:- Navigate to the “Data Sources” section
- Find the data source you want to delete
- Click the “Delete” button
- Confirm the deletion
Data Source vs. Collections
It’s important to understand the relationship between data sources and collections:- Data Sources: Define where and how to connect to your data. They provide access to the raw data but are not directly queryable.
- Collections: Created from data sources, collections let you organize, define schemas, and ultimately query your data.
- Use a single data source to create multiple collections with different views of the data
- Apply specific transformations or filters to each collection
- Manage permissions at the collection level
- Create optimized query interfaces for different use cases
Data Source Security
DataGyro takes security seriously and implements several measures to protect your data source connections:- All connection credentials are encrypted at rest
- SSL/TLS encryption for data in transit
- Role-based access control for data sources
- No storage of raw data - DataGyro only connects to your sources
- Regular security audits and updates
Troubleshooting Connection Issues
If you’re having trouble connecting to a data source, check the following:- Connection Details: Verify that hostname, port, database name, username, and password are correct
- Network Access: Ensure that your database server allows connections from DataGyro’s IP addresses
- Firewall Settings: Check if there are any firewall rules blocking the connection
- Database User Permissions: Verify that the user has appropriate SELECT privileges
- SSL Requirements: If your database requires SSL, ensure the SSL settings are properly configured
Upcoming Data Source Features
We’re actively working on expanding our data source capabilities. Coming soon:- Additional SQL database support (SQL Server, Oracle, SQLite)
- Document integration (PDF, Word documents)
- File-based data sources (JSON, CSV, Parquet, Excel)
- Unstructured data support
- No-code data import wizards
Collections
Learn how to create collections from your data sources
Querying
Discover how to query your collections