I have 192 XLSX files I converted to CSV files all about 45K in size.
I have a process that compares same files twice, and posts results to website, results color coded. Once with filters, once without.
My performance doesn't change whether all work is performed locally on a W2K8 based Windows server or if output files are posted to another server.
I can run a non filtered file comparison in batch in less than 2 minutes creating HTML result file output.
If in my script I choose to ignore differences, the session fill ignore 6 RegExp date formats and 3 string formats, the process in batch now runs over 3 hours for those same 192 45K CSV files.
If I run it in the GUI as a folder compare, takes less minute to do the exact match versus fuzzy match. If I click each file the HTML is shown instantly, and I'm pretty sure if I clicked each of the 192 compares, I'd see HTML results for all in less than 5 minutes.
I'm not sure what all I need to show for RegExp rules, script, a sample file?
Maybe the issue is in my side, I just don't know. I know filtering stuff over each full line each line isn't free, but wow, 3 hours.
Any help would be appreciated.
doug
I have a process that compares same files twice, and posts results to website, results color coded. Once with filters, once without.
My performance doesn't change whether all work is performed locally on a W2K8 based Windows server or if output files are posted to another server.
I can run a non filtered file comparison in batch in less than 2 minutes creating HTML result file output.
If in my script I choose to ignore differences, the session fill ignore 6 RegExp date formats and 3 string formats, the process in batch now runs over 3 hours for those same 192 45K CSV files.
If I run it in the GUI as a folder compare, takes less minute to do the exact match versus fuzzy match. If I click each file the HTML is shown instantly, and I'm pretty sure if I clicked each of the 192 compares, I'd see HTML results for all in less than 5 minutes.
I'm not sure what all I need to show for RegExp rules, script, a sample file?
Maybe the issue is in my side, I just don't know. I know filtering stuff over each full line each line isn't free, but wow, 3 hours.
Any help would be appreciated.
doug
Comment