Folder
Adding Folder as a data source
-
From the left navigation panel, click Lakehouse and then click Data Sources.
-
From the upper right corner of the page, click the + New Database button to start the process of adding a new database.
-
In the New Data Source page, click the Folder icon.
-
Specify the following details to add folder. Once you have connected a data source, the system immediately fetches its schema. After this schema retrieval process is complete you can browse and interact with the tables and data.
Field Description Connection name Enter a unique name for the connection. File Format Specify any of the following file formats: CSV, Parquet, JSON, Excel Separator Specify the separator character. Header Toggle to indicate if the first row of your CSV contains column headers. This field is displayed only when the file format is CSV. Infer Schema Toggle to automatically determine the data type of each column in your data. This field is displayed only when the file format is CSV. Compression Select the file compression mode from any of the following options: Uncompressed, gzip, lzo, brotli, lz4, and zstd. Null Value A set of case-sensitive strings that should be interpreted as null values. For example, if the value 'NA' should be interpreted as null, enter 'NA' in this field. -
Click Submit.
After creating a data source, add a new folder to define a unique data table. Any files uploaded to this folder will be automatically merged to populate the table's data.

To upload, download, or delete files within a specific folder, click the folder name or access the settings menu. The Files tab will provide you with the necessary options.

-
Adding files of different schemas in the same folder is not supported.
-
Multi tab excel files are not supported.
-
Folder names cannot be only numbers. Validation is yet to be added.