10 Jul 2003
(updated 15 Jul 2003 at 01:49 UTC) »
Cool! In my quest for more digits of Pi I found a Univeristy in Japan offering 4.2 billion digits to download for the general public. They are on their way down to my server. Once there I plan to revive my Pi search engine and allow it to search 4.2 billion digits! I think I'll have to implement some sort of Pi searching queue so that only one search is processed at a time since this will probably be a bit tough on my servers.
Update: So I've been working on my Pi search engine, trying to scale it up to 4.2B digits and have run into a snag. My previous search engine just mmap'd the whole mess and then used that to seek back and forth in. This does not, however, work with this much data since x86's can only mmap 2^32 bytes of memory and big chunks of that are, as I understand, already used up by the kernel and whatnot. So it looks like I'll have to change the algoritm to either not use mmap or to use several smaller files and hop between them. Ugh.
Kyle had an interesting idea. Since usually we are searching for phone numbers I could index all the phone numbers in the first 4.2B digits of Pi into some sort of database. I'm thinking my K62/550 probably isn't up to the challenge :)
Another update: Marco Aur?lio Graciotto Silva mailed me with this link to a distributed PI calculation project. Unfortunately the challenge is over :(