Data error importing large dataset

This forum is closed, and read-only.
Locked
gav888
PLS Junior User
Posts: 5
Joined: Thu Mar 19, 2015 4:54 pm
Real name and title: Dr Giuseppe Veltri

Data error importing large dataset

Post by gav888 »

I am experiencing a problem when I am trying to import a large dataset (56,000 observations). No matter which textual format I use (csv., tab), smartPLS gets stuck. I have increased the allocated RAM to minimum 2GB and max 6GB without any success.

Any solution?

Thank you in advance

GV
gav888
PLS Junior User
Posts: 5
Joined: Thu Mar 19, 2015 4:54 pm
Real name and title: Dr Giuseppe Veltri

Re: Data error importing large dataset

Post by gav888 »

UPDATE: Giving enough time, smartpls does return functional but imports only a fraction of the dataset (4600 out of 56000).
gav888
PLS Junior User
Posts: 5
Joined: Thu Mar 19, 2015 4:54 pm
Real name and title: Dr Giuseppe Veltri

Re: Data error importing large dataset

Post by gav888 »

Problem solved. It has to do with the CSV format regarding line ending. SmartPLS assumes that is the windows one but you convert in cvs in a MAC, it is not. Hence, using a MAC you have to take care of this conversion before importing into SmartPLS.
Locked