Re: Best tool for large (500MB) text manipulation
Re: Best tool for large (500MB) text manipulation
- Subject: Re: Best tool for large (500MB) text manipulation
- From: Jason Belec <email@hidden>
- Date: Sun, 17 Oct 2004 16:03:47 -0400
If I may... I usually keep quiet but I ran into issues in the past that
might be helpful.
BBEdit is not limited on large files, mine range from a few MB to 5-6GB
on average.
Just don't open the file to do search and replace or run Grep patterns.
I use BBEdit to handle large RIB files (Renderman) and have for many
years. I use some Apple scripts to move and sort and even a shell or
two, but BBEdit will handle massive amounts of data very fast - just
don't ask it to do it in memory or virtual memory. One more thought,
you won't be able to undo with this approach.
Jason Belec
On 17-Oct-04, at 3:48 PM, Bruce Robertson wrote:
From: Bruce Robertson <email@hidden>
I have a relative who deals with very large data files, for example
500MB
text files. He needs to find, extract, and manipulate data from them.
He has
been using BBEdit but is coming up against its limits. The
application
happens to be analysis of stock trading data.
What sort of 'limits' is he hitting?
Unfortunately all this is a result of a brief conversation and no deep
knowledge of what he's doing. I'm not sure whether having me in the
middle
of the conversation will accomplish much.
What sort of capabilities of BBEdit is he using?
What sort of CS knowledge does he have? (How much is he willing to
learn? :-)
He's an extreme geek. Very very knowledgable. Does a lot of stuff with
Sed
and AWK already so these are tools he uses and can apply. Passes data
to a
custom analysis program he's written in C. Has been involved
professionally
in seismic analysis and chaos theory applications.
_______________________________________________
Do not post admin requests to the list. They will be ignored.
Applescript-users mailing list (email@hidden)
Help/Unsubscribe/Update your Subscription:
email@hidden
This email sent to email@hidden
_______________________________________________
Do not post admin requests to the list. They will be ignored.
Applescript-users mailing list (email@hidden)
Help/Unsubscribe/Update your Subscription:
This email sent to email@hidden