• Open Menu Close Menu
  • Apple
  • Shopping Bag
  • Apple
  • Mac
  • iPad
  • iPhone
  • Watch
  • TV
  • Music
  • Support
  • Search apple.com
  • Shopping Bag

Lists

Open Menu Close Menu
  • Terms and Conditions
  • Lists hosted on this site
  • Email the Postmaster
  • Tips for posting to public mailing lists
Re: How to match data in two different text files as fast as possible?
[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: How to match data in two different text files as fast as possible?


  • Subject: Re: How to match data in two different text files as fast as possible?
  • From: Takaaki Naganoya <email@hidden>
  • Date: Sat, 12 Aug 2006 16:23:53 +0900
  • Thread-topic: How to match data in two different text files as fast as possible?

Use openssl and compare MD5 checksum. It is the fastest way to compare
between huge data.

--
Takaaki Naganoya
Piyomaru Software
http://piyo.piyocast.com

On 06.8.12 3:38 PM, "Richard Rönnbäck" <email@hidden>
wrote:

> I need to match data from two different text files, but none of the
> techniques I know are fast enough, so I am hoping that someone will be able
> to give me some good suggestions.
>
>
> The first file I have consist of tabbed lines of data, like this:
>
>  FilePaths  someData  someData2     someData3   moreColumns
>
>
> The other file consist of tabbed lines with just:
>
> FilePaths   UniqueID
>
>
>
> In other words, the first file set is missing data that can be found (only)
> in the second file.
>
> What I need to do then is see whether each FilePath in the first file exist
> in the second file and the append the corresponding UniqueID to the end of
> that line. When all lines are processed the result should be written to a
> file, so that I end up with:
>
> FilePaths  someData  someData2     someData2   moreColumns  UniqueID
>
>
>
> For lines that cannot be matched, the UniqeID field should either be empty
> (just a tab stop) or better yet, say something like N/A. I should probably
> also mention that the filePaths that should be matched may contain special
> characters like (,.åäö,{  etc.
>
> The problem is that both these files may contain anything from 1000 to 50000
> lines and this makes every AppleScript technique I know much too slow and
> the special characters is more  than my very limited knowledge of shell
> tools can handle.
>
> Please give me a helping hand with this
>
>
> Thanks in advance
>
> // Richard
>
>
>
>
>  _______________________________________________
> Do not post admin requests to the list. They will be ignored.
> Applescript-users mailing list      (email@hidden)
> Help/Unsubscribe/Update your Subscription:
>
> This email sent to email@hidden
>


 _______________________________________________
Do not post admin requests to the list. They will be ignored.
Applescript-users mailing list      (email@hidden)
Help/Unsubscribe/Update your Subscription:

This email sent to email@hidden

References: 
 >How to match data in two different text files as fast as possible? (From: Richard Rönnbäck <email@hidden>)

  • Prev by Date: Re: INDESIGN CS2: Altering a Text Selection
  • Next by Date: Problem with curl
  • Previous by thread: How to match data in two different text files as fast as possible?
  • Next by thread: Re: How to match data in two different text files as fast as possible?
  • Index(es):
    • Date
    • Thread