Friday, November 23, 2007

Benchmarks*: Diskeeper 2008 Pro Premier 12.0.758.0

The benchmark results of Diskeeper 2008 Pro Premier are available in a spreadsheet. A quick summary of the results: the $99 Diskeeper 2008 doesn't always work as well as the free Windows Disk Defragmenter (WDD) supplied with Windows XP, and only marginally faster than DK2007. Once more I am at a loss to explain why only one of the tests achieved a result 3.9% better than WDD, or why the final I-FAAST test caused a slower result.
The graph shows Diskeeper 2008 Pro Premier (DK) in dark blue, and the results from Windows XP in light blue. The first test is at the bottom, and shorter lines mean faster times.
  • "Basic XP" refers to the standard install, without Office 2007, so there are only 710 files to be tested.
  • "Defrag" refers to the read times of the same 710 files, after several defrag passes using the DK program, with no "Optimize Files" or "Optimize Boot" options enabled. A 12.8% performance improvement is measured, almost identical to the WDD result.
  • "Defrag+Auto" refers to the read time after enabling "Optimize Boot" functions in Windows, and the I-FAAST option in Diskeeper. An improvement of 27.0% is recorded.
  • "XP+Auto" is the result obtained after enabling both "Optimize Files" and "Optimize Boot" functions in Windows, and then running WDD, i.e. the best that Windows XP can manage.
  • "Basic Office" refers to the read time of all 802 test files, where no defragmentation has been done whatsoever, after the installation of Microsoft Office 2007 Professional (Trial).
  • "Full Defrag" refers to the read time of all 802 test files after several reboots and several passes using the DK program, with no I-FAAST or "Optimize Boot" options enabled. A 30.7% performance improvement has been measured, the best result so far, but only 3.9% better than "Office Auto" below.
  • "I-FAAST+Auto" is the result obtained after enabling and "Optimize Boot" functions in Windows, and then running DK with I-FAAST enabled . This performance improvement of 16.7% is not as good as was expected, and slower than "Office Auto".
  • "Office Auto" is the result obtained by allowing Windows XP to do its own defrag after enabling both "Optimize Files" and "Optimize Boot" functions.
The performance improvement ranges between 12% and 30%, with better results obtained when the built-in Windows functions are employed; "Optimize Boot" is enabled by default. The only advantage is that DK2008 allows for automatic defragmentation. Still, an average 21.8% performance improvement over no defrag at all isn't bad, but I expected much better from a program that costs $99. Disabling I-FAAST provides the equivalent functionality of the $49 Diskeeper 2008 Professional, but even so this is one of the most expensive defrag packages available.
I enabled most options in DK2008, including directory consolidation, InvisiTasking, statistics collection, and so on. The top graphic shows the end result of all the tests, but the directories are still scattered around and the large clump of files at the end is presumably the result of I-FAAST moving older files to the end. I suspect this may also account for the slower performance, but can't explain why I-FAAST would think that any of the files being tested are "old" or "slow".
I did not enable the "Optimize Files" option because I didn't want it to clash with or degrade the I-FAAST facility, which represents half the cost of DK2008 Pro Premier. Clearly more work has gone into the methods used to defragment the drive, but the performance gains come with a very hefty price tag. The next program to be tested is O&O Defrag Professional Edition 10.0.1634.

Diskeeper 2008 Professional: Preliminary Results | First Impressions | A Closer Look at the DK2008 Review on 3DProfessor.org: Part 1 | Part 2 | Part 3 | How Fast is I-FAAST™? | Diskeeper 2007 Review | DK2007 Benchmark
*See: Benchmarks*: Why the Asterisk?

Thursday, November 22, 2007

Benchmarking Data Files

It has been relatively easy to measure the load times of system and application files using my "Prefetch File Processor" program, and the initial results are quite interesting, especially the performance of WDD itself.
But I get the feeling that I'm only measuring a part of the total user experience. After all, we use applications to do work, and the work component isn't being measured at the moment. The data types that I'd like to benchmark are:
  • Podcast files: these are usually MP3 files, with several being downloaded at once, and each feed stored in a different folder, like iTunes;
  • email folders: these grow by small amounts each day;
  • Office documents: these are stored in multiple folders, and not all of them are current;
  • Pictures/music: varying sizes, and many files in a single folder;
  • Folders: a multi-level folder structure with varying numbers of files in each folder; and
  • Database files: grow with use, and need to be repaired and compacted from time to time.
What other file categories have I missed? Do I create programs that constantly edit and make changes and run while the defrag program is trying its best, or do I create a program that generates the files or makes changes to them, and then stops to give the defrag program a chance? Your thoughts are welcome, and I'll start developing something when my workload subsides a bit further.
Update: after a really useful chat with the guys on the Wilders Security Forums, I have decided to use the BootVis trace utility in the next round of testing.

Benchmarks*: Diskeeper 2007 Pro Premier 11.0.698.0

The review of Diskeeper 2007 Pro Premier is here, and I have uploaded the results of the benchmark tests in a spreadsheet. A quick summary of the results: the $99 Diskeeper 2007 doesn't always work as well as the free Windows Disk Defragmenter (WDD) supplied with Windows XP. I am at a loss to explain why only one of the tests achieved a result 2.4% better than WDD, or why the final I-FAAST test caused a slower result.
The graph shows Diskeeper 2007 Pro Premier (DK) in dark blue, and the results from Windows XP in light blue. The first test is at the bottom, and shorter lines mean faster times.
  • "Basic XP" refers to the standard install, without Office 2007, so there are only 710 files to be tested.
  • "Defrag" refers to the read times of the same 710 files, after several defrag passes using the DK program, with no "Optimize Files" or "Optimize Boot" options enabled. Only 8.7% performance improvement is measured.
  • "Defrag+Auto" refers to the read time after enabling "Optimize Boot" functions in Windows, and the I-FAAST option in Diskeeper. An improvement of 11.5% is recorded.
  • "XP+Auto" is the result obtained after enabling both "Optimize Files" and "Optimize Boot" functions in Windows, and then running WDD, i.e. the best that Windows XP can manage.
  • "Basic Office" refers to the read time of all 802 test files, where no defragmentation has been done whatsoever, after the installation of Microsoft Office 2007 Professional (Trial).
  • "Full Defrag" refers to the read time of all 802 test files after several reboots and several passes using the DK program, with no I-FAAST or "Optimize Boot" options enabled. A 29.6% performance improvement has been measured, the best result so far, but only 2.4% better than "Office Auto" below.
  • "I-FAAST+Auto" is the result obtained after enabling and "Optimize Boot" functions in Windows, and then running DK with I-FAAST enabled . This performance improvement of 14.4% is not as good as was expected, and slower than "Office Auto".
  • "Office Auto" is the result obtained by allowing Windows XP to do its own defrag after enabling both "Optimize Files" and "Optimize Boot" functions.
The performance improvement ranges between 8% and 29%, with better results obtained when the built-in Windows functions are employed; "Optimize Boot" is enabled by default. The only advantage is that DK2007 allows for automatic defragmentation. Still, an average 16% performance improvement over no defrag at all isn't bad, but I expected much better from a program that costs $99. Disabling I-FAAST provides the equivalent functionality of the $49 Diskeeper 2007 Professional, but even so this is one of the most expensive defrag packages available.

The DK2007 display shows how the "InvisiTasking" operation works when not much processing is going on. I used the Windows Performance Monitor to monitor % hard drive activity (not shown above), shown below as a red line, while the % processor time is shown in green.
Even though this is a "background" task it can keep the hard drive pretty busy while it runs.
I enabled most options in DK 2007, including directory consolidation, InvisiTasking, statistics collection, and so on. The very top graphic shows the end result of all the tests, but the directories are still scattered around and the large clump of files at the end is presumably the result of I-FAAST moving older files to the end.
I did not enable the "Optimize Files" option because I didn't want it to clash with or degrade the I-FAAST facility, which represents half the cost of DK2007 Pro Premier. The next tests will be Diskeeper 2008 Pro Premier. Hopefully a better result can be obtained.

Wednesday, November 21, 2007

Benchmarks*: Auslogics Disk Defrag 1.4.10.249

The review of an earlier version of Auslogics Disk Defrag is here, and I have uploaded the results of the benchmark tests in a spreadsheet. A quick summary of the results is simple: it doesn't work as well as the Windows Disk Defragmenter (WDD), which is supplied with Windows XP. Since this program is also freeware, the only thing going for it is that the interface is friendly and the results are shown in a graph. That's about it.
The graph shows Auslogics Disk Defrag (ADD) in dark blue, and the results from Windows XP in light blue. The first test is at the bottom, and shorter lines mean faster times.
  • "Basic XP" refers to the standard install, without Office 2007, so there are only 710 files to be tested.
  • "Defrag" refers to the read times of the same 710 files, after several defrag passes using the ADD program, with no "Optimize Files" or "Optimize Boot" options enabled. Only 8.2% performance improvement is measured.
  • "Defrag+Auto" refers to the read time after enabling both "Optimize Files" and "Optimize Boot" functions in Windows. Think of it as ADD with help from Windows. An improvement of 11.5% is recorded.
  • "XP+Auto" is the result obtained after enabling both "Optimize Files" and "Optimize Boot" functions in Windows, and then running WDD, i.e. the best that Windows XP can manage.
  • "Basic Office" refers to the read time of all 802 test files, where no defragmentation has been done whatsoever, after the installation of Microsoft Office 2007 Professional (Trial).
  • "Full Defrag" refers to the read time of all 802 test files after several reboots and several passes using the ADD program, with no "Optimize Files" or "Optimize Boot" options enabled. A 16.8% performance improvement has been measured.
  • "Full Defrag+Auto" is the result obtained after enabling both "Optimize Files" and "Optimize Boot" functions in Windows, and then running ADD. This improved the performance to 23.3%
  • "Office Auto" is the result obtained by allowing Windows XP to do its own defrag after enabling both "Optimize Files" and "Optimize Boot" functions.
The performance improvement ranges between 8% and 23%, with better results obtained when the built-in Windows functions are employed, using Disk Idle Optimiser to enable them. The results are not as good as WDD, but fewer defrag passes are required, and the defrag program works nicely. Still, a 15% performance improvement isn't bad.
I look forward to see how Diskeeper 2007 performs. The testing has begun.

Auslogics Disk Defrag review | download
*See: Benchmarks*: Why the Asterisk?

Monday, November 19, 2007

The Ideal Defrag Utility

What does your ideal defrag program look like? Everyone has their own preference, but for me it would include the following key points:
  • Easy to set up for first time users. I don't mean the install process, I mean there must be a wizard the user can run, answer questions about how s/he uses the computer, and the options are set for them.
  • Must do a defrag when asked to. There is nothing worse than a defrag program that says "no" or does nothing when you click on the defrag button.
  • Option of a thorough or quick defrag. The thorough defrag should start at the beginning and go through all files, fixing things as it goes along. The quick defrag could be used to make some basic improvements but not take too long. The two options must not contradict each other wherever possible.
  • Cater for all kinds of files, including system files, metadata, MFT, and so on.
  • It must show the user in detail what it is doing. The user must know what is going on, and be able to determine where any given file is, and see what files are causing logjams or other problems.
  • All options must be available from startup options or the command prompt. I'd like to be able to create a second icon on the desktop with some special options for a particular need.
An advanced user option would also be to be able to move any given file to a particular location on the disk, as a means of being able to sort out logjams manually.
I know of no program that does all of these, but there are a handful that come close. PerfectDisk does many of these things, but not all. I guess there is room for improvement in most packages. I'd welcome comments from readers.

Hear the podcast from the PerfectDisk blog | Part 2 - MP3 version (2.58MB) | Part 1 (2.91MB) article

Benchmarks*: Windows XP Disk Defragmenter

The first benchmark results are for the built-in Windows XP Disk Defragmeter (WDD). This composite image shows the "before" and "after" file layout of the test system. The defrag program was run numerous times between these two results, so don't expect to achieve this in one pass, or even in one day.
This graph shows the results in a more accessible form. The first test is at the bottom, and shorter lines mean faster times.
  • "Basic XP" refers to the standard install, without Office 2007, so there are only 710 files to be tested.
  • "WDD" refers to the read times of the same 802 files, after several defrag passes using the WDD Defrag button. A 26% performance improvement is measured. You could expect this result on a "clean" install machine.
  • "Basic Office" refers to the read time of all 802 test files, where no defragmentation has been done whatsoever, before or after the installation of Microsoft Office 2007 Professional.
  • "Full WDD" refers to the read time of all 802 test files after several reboots and several passes using the WDD defrag button. A 28% performance improvement has been measured.
  • "Auto" is an interesting result. The system was left without any defragmentation, but rebooted once or twice a day for 6 days. This was done by changing the date on the laptop, and allowing several hours between each reboot.
The only difference between the "Auto" and "Full WDD" is a change in one of the Windows registry values (the default is 0):
[HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft
\Windows\CurrentVersion\OptimalLayout]

"EnableAutoLayout"=1
You can set this using a simple registry file, or by using the "UnityPro Disk Idle Optimiser" program. This registry entry causes Windows XP to optimise the layout of regularly used program and system files only, not data, so it isn't quite the same as an automatic defrag. Also make sure the following registry key is set (the default is "Y")
[HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft
\Dfrg\BootOptimizeFunction]

"Enable"="Y"
Conclusion: WDD can reduce program load times by around 27% compared to a badly maintained system. Scheduling a regular defrag (once a month for low-usage systems) will help prevent the system from experiencing major slowdowns caused by file fragmentation. if your system starts getting sluggish, try running WDD's Defrag manually. Also use a program like CCleaner to clean out junk from your system. Another useful option is the undocumented "defrag c: -b" command, which is supposed to do the boot optimize on demand.

Saturday, November 17, 2007

The Great Defrag Shootout Round 2 - Benchmarks

The image above shows a snapshot of a newly-installed version of Windows XP SR2, with Internet Explorer 7 and .NET Framework 1.1 and 2.0 installed. There are plenty of fragmented files, many of which are caused by the downloaded security updates and patches. The yellow files are fragmented, and the start of the hard drive is the bottom left. The pink area is the reserved space for the Master File Table (MFT).
Here is a more familiar picture of the drive, using WDD. The red files are fragmented, and the MFT reserved space is just shown as empty space.
I have set up my test laptop, an IBM ThinkPad R31 with a 20GB hard drive, and using Acronis True Image Home 11 recovery CD I have made a protected partition for backups, and a main NTFS partition (C:) of 8,497 MB for Windows. There is a smaller partition of around 1GB just for storing results. The C: partition is backed up and restored using a "sector-by-sector" method, so that I can reproduce the messy arrangement of the drive whenever I want to run a new set of tests.
I have installed the following software on the basic test machine:
The idea is to create a "typical" workstation that reflects currently available software. Some of the utilities are used to take measurements, and others were used to set up the workstation the way I normally set up computers I install software on.

Testing the system

The data collection process works like this:
  1. Restore the full drive image, including all fragments.
  2. Install and updated version of prefetch.exe with the correct testing files.
  3. Install the required test defrag program.
  4. Reboot and run the first round of tests.
  5. Allow the defrag program to do its best to defrag the drive. This may take several attempts and several reboots.
  6. Reboot and run the second round of tests.
  7. Install Microsoft Office 2007 Professional trial edition.
  8. Reboot and run the third round of tests.
  9. Open a test document as part of "normal usage"
  10. Allow the defrag program to do its best to defrag the drive. This may take several attempts and several reboots.
  11. Reboot and run the fourth round of tests.
  12. Run HD Tune to test the hard drive.
  13. Copy all the test results off the drive and analyse them.
Each "round of tests" consists of running Prefetch.exe, using this layout.txt file. This is followed by JkDefrag in "Analyse" mode, and storing a screen shot of the drive image, as well as the JkDefrag log file.
The idea is to emulate the normal process of software installation and use. I chose Office 2007 Professional (Trial Edition) because it is a large, legal install, creating numerous new folders and adding a lot of stuff to the system as a whole, including DLLs, fonts, and so on. The defrag program should be able to cope with these changes.
The current Prefetch.exe install also includes an installation of my "Delay Launch" program. A shortcut is placed in the Startup menu, and 240 seconds (4 minutes) after the system reboots it loads the "prefetch.exe" program. The program attempts to measure the read time of 842 files, 39 belonging to Office 2007, and the remaining 802 belonging to Windows and the other preinstalled software.
The benchmark is run at the same time after each reboot, to ensure consistency. If a program like Diskeeper is being tested, the Diskeeper service is disabled before the reboot, so the measurements are not affected by the software being tested.
I used HD Tune to test the speed of the drive under normal conditions after a reboot, and the graph is shown here. I will post the results as they become available, complete with the raw data in spreadsheet form, so others can examine the data and provide comments.

Friday, November 16, 2007

Spammer Wins Darwin Award

This has to be the dumbest spammer on the planet. Granted, he did manage to get through two anti-spam systems to my inbox, but that's where the cleverness ends. First of all, the "From" part is described as "VIAGRA ® Official Site" which is a dead giveaway. Does he think I really believe that Pfizer needs to do direct marketing? To add insult to injury the "From" address is my own address, making it pretty easy to set up an email rule to send all mail from me back to me into the "Deleted Items" folder. DUH!
But the clincher is the subject. A few months ago when the messages started, the discount was in the 50% range, and then increased to 60% and so on. Now the "discount" is going up by a few % a day. At this rate they'll be paying me to buy the stuff in early January. What kind of an idiot gives this kind of discount in the first place, and how long does he want me to hold out for a better discount?
I guess this is a severe case of "It is morally wrong to allow a sucker to keep his money", but with a twist. The sad thing is that someone, somewhere, is going to buy from this site, and wonder why the pills never arrive. Anyone want to help transfer money from Nigeria in order to buy the Brooklyn Bridge?