Go Back   Scooter Forums > Beyond Compare 3 Discussion > File Formats vs. Rules
Register FAQ Search Today's Posts Mark Forums Read

Reply
 
Thread Tools Display Modes
  #1  
Old 22-Aug-2011, 08:32 AM
scheperw scheperw is offline
Visitor
 
Join Date: Aug 2011
Posts: 3
Default MultiLine CSV Cells Revisited

I'm trying to compare "CSV" files that have formatted text in columns. This results in line feeds (not sure if there is a carriage return) in the cells. I've read the earlier posts about changing the Line Ending format in 3.2 I think but can't navigate to these settings on 3.3.1. Please assist.
Reply With Quote
  #2  
Old 22-Aug-2011, 09:49 AM
Aaron Aaron is offline
Team Scooter
 
Join Date: Oct 2007
Location: Madison, WI
Posts: 7,358
Default

Hello,

Are you comparing your CSV files in the Data Compare session type?

Do you have Quotes or another delimiter around the formatted text that should be in a single column? If so, you can define the Text Qualifier in the File Format's Type tab to make the whole string appear in a single column/cell.
__________________
Aaron P Scooter Software
Reply With Quote
  #3  
Old 22-Aug-2011, 01:24 PM
scheperw scheperw is offline
Visitor
 
Join Date: Aug 2011
Posts: 3
Default

Yes we are using Data Compare session. The CSV format is for Sybase IQ. It doesn't allow use of Quotes unless every column is quoted. Quoted columns with quoted data was behaving squirrelly as a result we are avoiding use of quotes. We are using ^ as the delimiter character as it isn't seen in our data. Every column is bounded within the delimiter ^ including the final column. Sybase IQ parses the multi-lines properly and loads data between delimiters. Apparently it is counting the columns rather than using the end of line.
Reply With Quote
  #4  
Old 23-Aug-2011, 02:59 PM
Aaron Aaron is offline
Team Scooter
 
Join Date: Oct 2007
Location: Madison, WI
Posts: 7,358
Default

Hello,

Would it be possible to define your files in a way so that each column is delimited with a character (such as , or |) and then every column is also quoted with another non-quote character (such as ^)? This would allow you do define the delimiter of the file format as , and the text qualifier as ^, which would then swallow the line breaks within the text within the column.
__________________
Aaron P Scooter Software
Reply With Quote
  #5  
Old 24-Aug-2011, 12:59 PM
scheperw scheperw is offline
Visitor
 
Join Date: Aug 2011
Posts: 3
Default

Aaron,
I was able to combine the use of ^ with Quote to produce comparable files with mult-lines. I can verify the data with Quotes and then switch the Quotes off in the ETL process.

This is a good work around and allows me to validate my work. If BC can be enhanced to handle the lines without the Quotes using only the delimiters it would be more compatible with the load files generated for Sybase IQ. This has the advantage of testing production files as they will be created.
Reply With Quote
  #6  
Old 25-Aug-2011, 12:46 PM
Aaron Aaron is offline
Team Scooter
 
Join Date: Oct 2007
Location: Madison, WI
Posts: 7,358
Default

Thanks for the suggestion. I'll add it to our Customer Wishlist.

I'm glad the workaround works well for you.
__________________
Aaron P Scooter Software
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Forum Jump


All times are GMT -6. The time now is 05:14 AM.


Powered by vBulletin® Version 3.7.1
Copyright ©2000 - 2014, Jelsoft Enterprises Ltd.