• Open Menu Close Menu
  • Apple
  • Shopping Bag
  • Apple
  • Mac
  • iPad
  • iPhone
  • Watch
  • TV
  • Music
  • Support
  • Search apple.com
  • Shopping Bag
 

Lists

Open Menu Close Menu
  • Terms and Conditions
  • Lists hosted on this site
  • Email the Postmaster
  • Tips for posting to public mailing lists
Re: Best tool for large (500MB) text manipulation
[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: Best tool for large (500MB) text manipulation


  • Subject: Re: Best tool for large (500MB) text manipulation
  • From: Jason Belec <email@hidden>
  • Date: Sun, 17 Oct 2004 16:03:47 -0400

If I may... I usually keep quiet but I ran into issues in the past that might be helpful.

BBEdit is not limited on large files, mine range from a few MB to 5-6GB on average.
Just don't open the file to do search and replace or run Grep patterns.


I use BBEdit to handle large RIB files (Renderman) and have for many years. I use some Apple scripts to move and sort and even a shell or two, but BBEdit will handle massive amounts of data very fast - just don't ask it to do it in memory or virtual memory. One more thought, you won't be able to undo with this approach.

Jason Belec



On 17-Oct-04, at 3:48 PM, Bruce Robertson wrote:

From: Bruce Robertson <email@hidden>

I have a relative who deals with very large data files, for example
500MB
text files. He needs to find, extract, and manipulate data from them.
He has
been using BBEdit but is coming up against its limits. The application
happens to be analysis of stock trading data.

What sort of 'limits' is he hitting?

Unfortunately all this is a result of a brief conversation and no deep
knowledge of what he's doing. I'm not sure whether having me in the middle
of the conversation will accomplish much.


What sort of capabilities of BBEdit is he using?

What sort of CS knowledge does he have? (How much is he willing to
learn? :-)

He's an extreme geek. Very very knowledgable. Does a lot of stuff with Sed
and AWK already so these are tools he uses and can apply. Passes data to a
custom analysis program he's written in C. Has been involved professionally
in seismic analysis and chaos theory applications.


_______________________________________________
Do not post admin requests to the list. They will be ignored.
Applescript-users mailing list (email@hidden)
Help/Unsubscribe/Update your Subscription:
email@hidden


This email sent to email@hidden


_______________________________________________ Do not post admin requests to the list. They will be ignored. Applescript-users mailing list (email@hidden) Help/Unsubscribe/Update your Subscription: This email sent to email@hidden
References: 
 >Re: Best tool for large (500MB) text manipulation (From: Bruce Robertson <email@hidden>)

  • Prev by Date: Re: Best tool for large (500MB) text manipulation
  • Next by Date: Re: A grocery list
  • Previous by thread: Re: Best tool for large (500MB) text manipulation
  • Next by thread: Re: Best tool for large (500MB) text manipulation
  • Index(es):
    • Date
    • Thread