Saritta Hines 6 Posted October 1, 2019 Share Posted October 1, 2019 I have a csv file on HDFS and I am not sure how to view that file in Spotfire. I have installed the Spark and Impala connectors. Link to comment Share on other sites More sharing options...
Harshith Reddy Musku Posted October 1, 2019 Share Posted October 1, 2019 Hello, That CSV file should be converted to table representation in the data warehouse you have setup (Hive, Impala etc) on top of Hadoop, using the available options eg. OpenCSVSerde specifyingseparator/delimiter for Hive. For Impala -https://docs.cloudera.com/documentation/enterprise/5-6-x/topics/impala_txtfile.html#text_ddl Once the tables are created, you can use the corresponding connector (Cloudera Impala, Cloudera Hive, Apache Spark etc) to import those tablesin Spotfire Link to comment Share on other sites More sharing options...
Saritta Hines 6 Posted October 1, 2019 Author Share Posted October 1, 2019 Thank you! Trying that solution now Link to comment Share on other sites More sharing options...
Saritta Hines 6 Posted October 2, 2019 Author Share Posted October 2, 2019 I am now able to load in 5.6 million rows into Spotfire via the Impala connector and it took less than 2 seconds! We are using Cloudera, so I created a database in Hue and added a table and populated it with the csv file data. Link to comment Share on other sites More sharing options...
Recommended Posts
Create an account or sign in to comment
You need to be a member in order to leave a comment
Create an account
Sign up for a new account in our community. It's easy!
Register a new accountSign in
Already have an account? Sign in here.
Sign In Now