Jump to content

How convert csv files to parquet format in Spotfire


Rayane Boulic

Recommended Posts

Yes, Spotfire Data Science offers an operator to convert csv Hadoop files into Avro or Parquet :

Below is an excerpt of the documentation regarding this operator :

---------------------------------------------------------------------------------------------------------------------

Description

The Convert operator provides a method for converting a Hadoop csv file into either an Avro or Parquet format.

Configuration

Inputs

One CSV dataset from the preceding operator.

Parameters

Notes Enter any notes or helpful information about the parameter settings of this operator.

Format

Options:

Avro

Parquet

Default value: Parquet

Compression

Choose the desired compression of the output.

For Parquet, the compression options are:

GZIP

Deflate

Snappy

no compression

 

Outputs

Visual Output

Preview of the data.

Output To Succeeding Operators

A dataset of the chosen format and compression.

Link to comment
Share on other sites

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now
×
×
  • Create New...