Jump to content

Spotfire loading 1.5 billion records


sridhar tondapi

Recommended Posts

Hello All,

Approach# 1

we have a requirement to load ~1.5 billion records on a daily basis and using JDBC athena driver and files are in parquet format.

 

 

 

 

 

 

 

 

 

 

 

Table

Source

Volume

Refresh frequency

No# of reports

 

 

A

Athena

500 Millionn

Daily

10

 

 

B

Athena

500 Millionn

Daily

10

 

 

C

Athena

500 Millionn

Daily

10

 

 

 

 

 

 

 

 

 

 

 

 

 

 

what is the best approach for this

Link to comment
Share on other sites

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now
×
×
  • Create New...