Re: Best tool for large (500MB) text manipulation
Re: Best tool for large (500MB) text manipulation
- Subject: Re: Best tool for large (500MB) text manipulation
- From: Jeff Porten <email@hidden>
- Date: Wed, 20 Oct 2004 17:20:07 -0400
On Oct 20, 2004, at 2:05 PM, Bruce Robertson wrote:
A first step is to do some processing and selection from 500MB +/- text
files of trading data. All the other processing is done with custom C
routines and 4D, Filemaker, MySQL, etc are not a candidates.
If a client approached me and said, I have a project with these
parameters that needs to be built from scratch, I'd be looking at 4D to
do it, based on data size and UI requirements.
If a client asked me for a tool to take 500MB files and spit out
smaller subset files that could then be processed by existing routines,
my first thought would be Unix tools and regexps. If the selection
criteria were too complex (i.e., perhaps the criteria for record 10 is
partially based on records 1-9), I'd be back to 4D.
Since your guy is a Unix geek, I have to assume that he already knows
about regexps and these are insufficient for him. So that leads me to
say that I have insufficient data to make a recommendation.
But there are enough data to rule out AppleScript and FileMaker Pro
(excepting as front ends). The open question in my mind is between 4D
and an SQL tool.
Best,
Jeff
_______________________________________________
Do not post admin requests to the list. They will be ignored.
Applescript-users mailing list (email@hidden)
Help/Unsubscribe/Update your Subscription:
This email sent to email@hidden