Parquet

The Parquet Connector in Lumenore enables you to import data from Parquet files into the platform for analysis. Parquet is a columnar storage format optimized for performance and efficient data compression, making it ideal for large-scale analytics. Lumenore provides SQL-based access to Parquet files with full read and write capabilities.

Import Guidelines:

While importing data from Parquet files, ensure the following:

• Only the .parquet file format is supported.
• The first row must always contain column headers, even if the data is modified later.
• Avoid blank or empty data within the file.
• Remove all formatting except date formats before uploading the file to Lumenore.

Steps to connect:

Step 1: Navigate to Home > Connect Data > Select Connector > Parquet.

Step 2: Click “Browse File.”

Step 3: Select the file. The upload progress will be displayed.

Step 4: Once the file has loaded successfully, the file name appears in the download box.

Step 5: The next button is now enabled. Click “Next.”

Step 6: Select the table you want to export from Excel to the Lumenore database. You can also view the data by clicking the Preview tab. The Preview tab allows you to preview the table data, apply filters, and perform transformations.

Note: For more details, refer to Step 7 of the Excel Connector user guide.

Step 7: Click “Save Dataset” to complete data ingestion.

Step 8: Provide the Dataset name and description (optional). Click Ok.

Step 9: A “Dataset created successfully” message is displayed. After this, the user can cancel and start using the dataset or create a schema by clicking the Create Schema option.