Engee documentation

Data import

Engee supports various file formats for importing data. Before you start working - upload them to Engee file browser file browser 7. To import files, use the file browser 9 button or drag-and-drop into the file browser area:

desktop file browser

The Engee core, based on the Julia programming language, includes only the most basic packages by default. To add the ability to import files in the desired format, install additional packages using the package manager Pkg.

To view installed custom packages, use the Pkg.status() command.

With the base packages, Engee supports importing data from:

Import of data from other formats is realised using I/O functions (see Retrieving data from imported files) for details.

Importing big data

To work with Big Data, Engee uses the structure WorkspaceArray. CSV files and the tabular data structure DataFrame are used to import data into the WorkspaceArray.

To create a WorkspaceArray:

  • DataFrame - create a DataFrame based on existing data, for example:

    using DataFrames # подключаем пакет DataFrames
    times = [2 ^ i for i in LinRange(1, 3, 1000)]
    values = [sin(i ^ 2 + 1) * 2 + cos(i) for i in times]
    data_frame = DataFrame(time = times, value = values) # создадим DataFrame с двумя столбцами — time и value

    Create a WorkspaceArray from a DataFrame:

    my_workspacearray = WorkspaceArray("my_data_frame", data_frame)

    where my_workspacearray is a variable with the WorkspaceArray data type that contains data from a DataFrame named data_frame.

  • CSV - create CSV file from the received DataFrame:

    using CSV #подключаем пакет CSV
    CSV.write("/user/workspacearray_csv.csv", delim="\t", data_frame)

    Create a WorkspaceArray from the received CSV:

    workspacecsv = WorkspaceArray("workspacearray_csv", "/user/workspacearray_csv.csv") # где "/user/workspacearray_csv.csv" — путь до CSV-файла, а "workspacearray_csv" — его имя

To create a WorkspaceArray from an imported CSV, follow the conditions described by here. For advanced work with WorkspaceArray use AbstractVector functions.