Andrew Pollack's Blog

Technology, Family, Entertainment, Politics, and Random Noise

Example showing two views that LOOK and ACT the same, but one is 153 times larger

By Andrew Pollack on 10/06/2009 at 01:13 PM EDT

View indexes are the real culprit in performance on so many servers. One reason they're too big, is the use of the wrong @Function. Here's the result of a simple test I tossed together. I did this for my presentation on performance at AdminCamp a week ago. I thought I'd share it here.

Setup:
New database with two forms, both the same other than the form name. Form one has two documents created. Form two has two documents created. What's the difference then? The two documents using form two has have 30,000 response documents on them. The documents created from form one have no responses.

Next, I created four views, with selection formulas as follows:

View #1 -- SELECT form = "TEST1" | @AllDescendants
View #2 -- SELECT form = "TEST1" | @IsResponseDoc
View #3 -- SELECT form = "TEST2" | @AllDescendants
View #4 -- SELECT form = "TEST2" | @IsResponseDoc

In the database itself, views #1 & #2 look identical. Views number 3 and 4 also look identical to each other.

What about the difference in view sizes?

View #2 is 153 Times the Size of #1
and has the EXACT same content

This happens because the @IsResponseDoc formula selects ALL response documents in the database, including those not responses to the actual parents in the view. Those response documents don't display, because their parent isn't in the view -- so they're orphaned -- but they're still in the index. By using @AllDescendants, only responses where the parent is in the view are actually found.



Now imagine the savings if instead of 30,000 documents we were talking about 300,000 documents.


There are  - loading -  comments....

re: Example showing two views that LOOK and ACT the same, but one is 153 times largerBy Ben Langhinrichs on 10/06/2009 at 03:11 PM EDT
Great tip. Out of curiosity, I went to our internal Helpdesk and went to
Manage Views. The two largest views had exactly this problem, and one was
reduced to a fifth of the size when fixed, the other to about a third of the
size. Not as great as 1/153 of the size, but a substantial and measurable
improvement with no loss of function. Outstanding!

Now, I just have to go run Synopsis on every other large db I have. Sigh!
Why go that route?By Andrew Pollack on 10/06/2009 at 03:23 PM EDT
Just write an agent that runs through the db directory, opens all the views in
the databases, looks at the selection formula (all lotuscript) and does a seach
for that formula command -- you could, if you dare, just replace it and save as
the syntax is the same. Of course, that would cause a bunch of views to
rebuild.
re: Example showing two views that LOOK and ACT the same, but one is 153 times largerBy Stephan H. Wissel on 10/06/2009 at 04:27 PM EDT
Steal the code here:
http://www.wissel.net/blog/d6plinks/SHWL-7DDMJV

Of course you could change the background color if you find anyt of these:
@now @today @isResponseDoc

:-) stw
re: Example showing two views that LOOK and ACT the same, but one is 153 times largerBy Dan Soares on 10/07/2009 at 09:22 AM EDT
Andrew... awesome tip !

Dan
re: Example showing two views that LOOK and ACT the same, but one is 153 times largerBy Theo Heselmans on 10/06/2009 at 03:55 PM EDT
Nice tip, I never use either of these @functions because they were confusing.
Now I'll remember !
re: Example showing two views that LOOK and ACT the same, but one is 153 times largerBy Chris Blatnick on 10/06/2009 at 04:29 PM EDT
Nice one, Andrew! These are the tips that *every* Domino developer needs to
know.
re: Example showing two views that LOOK and ACT the same, but one is 153 times largerBy Jerry Carter on 10/07/2009 at 11:26 AM EDT
Impressive space savings!
re: Example showing two views that LOOK and ACT the same, but one is 153 times largerBy Andre Guirard on 02/28/2011 at 03:37 PM EST
This is a good tip, but beware that @IsResponseDoc doesn't behave exactly
identically to @AllDescendants. It's too long to explain here, so I wrote a
blog entry about it, which I'll post when Lotus' servers are back up (at the
moment Littleton's shut down, probably due to a downed wire in the ice storm).


Other Recent Stories...

  1. 09/04/2018With two big projects on hold, I suddenly find myself very available for new short and long term projects. In twenty five years, I don't think I've ever written an entry like this, but if you need the kind of work I do now would be a great time to get in touch. Both of the big projects I had lined up for late summer and early fall have been placed on hold and will be that way for a while. With the kids now all off at college and careers, I'm open to more travel than such than I have been in decades, but unless something else comes along, I'll be here working on updates to Second Signal and other things that ...... 
  2. 07/13/2018Who is HCL and why is it a good thing that they are now the ones behind Notes and Domino?We need to address some biases here. IBM has made a deal under which the Notes & Domino software and intellectual property is now being developed and maintained by HCL America. HCL America is part of the very large "HCL Technologies" company that has grown from its roots in India to become an 8 Billion Dollar company with a global presence in the IT Industry. You could be excused for initially believing, as many people do when they hear this, that "they've outsourced the code to India where they'll milk it ...... 
  3. 03/21/2018Domino Apps on IOS is a Game Changer. Quit holding back.BOOM. This will be as important for the platform as Traveler. If your company has ditched Notes and Domino, I feel sorry for you. For companies that do use Notes/Domino this is a game changer and Apple should be paying attention. Here's why: There are hundreds of little Notes client applications you'd never spend the time and money to build and deploy for your internal user base on IOS that we use Notes for all the time (those of us still using it). Now, those are suddenly ALL available on the iPad. ...... 
  4. 02/15/2018Andrew’s Proposed Gun Laws 
  5. 05/05/2016Is the growing social-sourced economy the modern back door into socialism? 
  6. 04/20/2016Want to be whitelisted? Here are some sensible rules for web site advertising 
  7. 12/30/2015Fantastic new series on Syfy called “The Expanse” – for people who love traditional science fiction 
  8. 10/20/2015My suggestion is to stay away from PayAnywhere(dot)com  
  9. 08/07/2015Here is one for you VMWARE gurus - particularly if you run ESXi without fancy drive arrays 
  10. 08/06/2015The Killer of Orphans (Orphan Documents) 
Click here for more articles.....


pen icon Comment Entry
Subject
Your Name
Homepage
*Your Email
* Your email address is required, but not displayed.
 
Your thoughts....
 
Remember Me  

Please wait while your document is saved.