Data connectors

Connectors are prebuilt integrations that enable Lumenore to connect to diverse data sources and securely ingest data in a structured format.

What are connectors?

A connector acts as a bridge between Lumenore and your data sources—such as databases, files, cloud warehouses, or business applications. Using connectors, users can either extract data from the source and load it into Lumenore’s Vertica database or use the Live connection feature to analyze data without loading it into Vertica.

If connection credentials are changed, deleted, or modified, Live connections will be disconnected. However, when data is loaded into Vertica, it remains unaffected by any subsequent credential changes in the source system.

Examples:

• Files: Excel, CSV
• Databases: PostgreSQL, Microsoft SQL Server, Azure SQL, SAP HANA
• Cloud / Big Data: Snowflake, BigQuery
• Business Apps: Salesforce, Zoho Books

Role of connectors

1. Data Access
   • Establish a secure connection to the source system.
   • For authentication, users must provide credentials such as connection type, host, database, schema, port, username, and password.
2. Data Ingestion
   • • Import or sync data from the source and load it into Lumenore’s database (Vertica),
     • Or use the data in Live mode without exporting it.
3. Data Standardization
   • Convert source-specific formats into a standard structure
   • Handle schema mapping, data types, and metadata
4. Test and Save Connection
   • After entering all connection details, test the connection and, once successful, save it.
   • Users can also use the connector without saving the connection.
5. Performance Optimization
   • • Push filters, aggregations, or queries to the source where possible
     • Enable efficient querying for large datasets (e.g., Snowflake, BigQuery)
6. Analytics Enablement
   • Once connected, data can be used for:
     • Dashboards & reports
     • Auto KPI generation
     • RCA (Root Cause Analysis)
     • AI insights

To start connecting your data:

Step 1: Log in to Lumenore using your credentials. You will be redirected to the home page.

Step 2: Click “Connect Data” to connect data from multiple sources, such as databases, cloud applications, or local files, and get a unified view of your business.

To watch a video tutorial on how to create a dataset, click the Play button.

Step 3: Now, click “Select Connector.”

You will be taken to the Lumenore Connect page, where you can choose your data source from the list of connectors to connect or import data.

Step 4: Search for your connector by typing its name or scrolling up and down to browse the list.

Step 5: The user can also search for connectors by category, such as Accounting, File & API, or CRM & ERP.