Separating and Querying the Papers

A persistent problem happens when a reference is double clicked or the index content tree is selected to show the entire book. It takes up to 30 seconds for the whole book to load into the viewing box. To handle this, I'm separating the book into it's papers and the viewing box will only show one paper at a time. This way, it'll be 195 times faster at loading the viewing results box.

This has higher priority than getting the Thesaurus up. The Thesaurus has a few leaps of programming for it to be done properly. The querying system is basically set up to handle 'AND' type of queries based on paragraphs. That is: When two words typed into the word box appear in any one paragraph, then that paragraph is shown in the reference list and the paragraph viewing window. 'OR' type of queries don't work yet. A Thesaurus is an 'OR' type of query. For example: When the word 'house' is selected and then the word 'abode' is selected into the word box from the Thesaurus list for 'home' then the query should say if this 'house' OR 'abode' appear in the same paragraph, then select that paragraph. Of course if an 'AND' word is added that will change the query and complicate it further. 

So the parser that determines the tests will have to work with one set of entries starting from the left of the word window entries and work towards the right side. If a parentheses is added to a set of 'AND' and 'OR' queries, then the those have to be determined first.

I never said it was easy and I never said I knew what I was doing!!!!

Thesaurus

The Thesaurus is created and the thesaurus window is open and it's setting the thesaurus words into it when a word is entered. Now I'll make it so that they can double click on the thesaurus word that they would like to add to the word window and then I'll add an 'OR' with parentheses around the word and it's thesaurus equivalent, then I can run through the book on an 'OR' instead of 'AND' on every paragraph. I'll also add an 'AND' when they click on words from the index word list on the right. If they type in directly, then I'll add the 'AND' automatically. 

Also have to create a help file. Probably be an HTML file created with some HTML document creator and that way they can read the help file. Maybe some Youtube videos showing how to do it.

It's coming along.

This coming week, I'll be attempting to place the index system on the Internet with Native Client's latest release. That should be interesing.


In this picture the top left window is the window you type in. The bottom left list window shows the thesaurus list relating to the current word being typed in. The word list to the right shows all the words in the Urantia Book. This is a view on a Nokia N900 phone. This will be available across all computers if I can get it up with Native Client.

Indexing some more

Lots of work completed this week. First, the windows had to be reduced in size to fit cell phones. Next I had to remove the database and just create files that we're directly inserted into the program because Native Client won't allow files to be used at this time. All done and working. It takes 20 seconds to initialize on a 600 mhz phone. Nothing to be done about that. All the phones that we're released this year should initialize in about 10 seconds. Reasonable for a program like this.

Completed the thesaurus but didn't get to use it in the program. That's next. Then, Native Client. I really don't know what I'm up against since the last time I created a simple program a month ago that ran in Native Client. Here's hoping that'll go easy and all machines will have the index in a week or two.

Step by step by step by step.

Urantia Book Index coming up

A few more bugs and the Urantia Book Index will be ready. It loads a lot faster, works with a thesaurus. This week I imagine it'll be working. Next week, I'll try it with Native Client on the net. At the very least, it works on my phone.

Indexing Plans

It took 45 seconds to start the index program on my n900 cell phone. It's just too slow starting up. Runs really well once it's started though. I have to do better and I can. The database is 45 megabyte with the thesaurus stuff. And the program loads most of it when it starts. It's obvious that is the problem.

Theres a better and faster way. First I don't need a sqlite database to store the index info as the book is static and doesn't need to change which is why I would need a database engine. So I'll keep the info in a file. In this way, I can keep all the pointer math in short integers and many other things can be done. I believe I can shorten by at least 3/4. Maybe more.

Also, I can store the index directly into the program. That's really exciting because Native Client will work without loading files so if it's built in, no file needs opening. I believe I can be up and running now. Wow.! That's just unbelievably exciting. The next few days will tell the tale. Maybe, if all goes well, in a couple of weeks.

Of course, there's a tale of the best laid plans of mice and men. Anyway......

Reprogramming The Index Program

Well I didn't seem to notice that the last iteration of the indexing system was missing a lot of text and papers we're jumbled or missing. So I'm rewriting the engine that reads each paper and indexes it. I don't like the algorithm as it stands. The thesaurus, though, looks good and works well with the blocks that exist in the database so I should be done with the index when this new algorithm is rewritten. An added benefit is that it should index the other languages also. 

The Index is working on Symbian and Maemo cell phones

Wow. Eventful couple of days. I can use the Urantia Book index from my Nokia N900 phone. Really had to work at getting just the needed information on screen as the screen real estate is really small. Will show it off at the meeting tonight. Of course, anyone can read the book on a phone using the system.

The book index is now a stand alone program so it's a lot smaller. That will make it easier to download. When I'm done here in the next few days, I'll send it up to the Nokia site for Symbian and Maemo phones to install from. Also I will place a Linux Debian (Ubuntu, Kubuntu and many others) and Windows program on my site for download. www.virtualurantia.com

As a side note, I have a content tree in one of the tabs that allows quick jump access to any part of the book.

The thesaurus is in the database but is not being used by the word lookup engine just yet. By next week. There's a few bugs cutting off words when creating the original index. Generally, though, it's working. Will fix them this week.

So to recap, by next week, I should have Symbian and Maemo phones, Windows and Linux desktops able to use the Urantia Book index.

Still waiting for Native Client, though, it's what will give me all computers and cell phones from the Internet.

Most people are trying to catch up to the changes in technology. In my field, we're always waiting for technology to catch up to our needs.

It's nothing but fun here.