My in-depth look at setting up and running a Mac Pro continues. In the first installment, I shared my out-of-the-box experience and ran some tests on some apps. In the second, I talked about my observations of working on the desktop, perform audio and video tasks, and use Boot Camp and Parallels Desktop to turn my Mac Pro into a Windows-running powerhouse.
In this third and final installment, I fire up my favorite games to test frame rates. I also test transfer speeds for FireWire drives and wrap it all up with a little methodology.
Gaming on the Mac Pro
Unlike the gaming section in my mini writeup, there’s no need to restrict what type of games I test on the Mac Pro. Whereas the mini lacks a graphics card of any kind, this Mac Pro is equipped with the built-to-order X1900 XT, ATI’s top-of-the-line Mac video card. Also, since I covered gaming peripherals before, I won’t go down that street again—basically, if they don’t need a driver and work on a PowerPC Mac, then they’ll work for sure. If they do need a driver, check the manufacturer’s site for an Intel-compatible version. This time, I thought it would be interesting to check in on one 3D graphics-based game that runs in Rosetta, as well as the one current game I own that runs on both Windows XP and OS X. I’ll also touch on the other games I looked at before, relative to their performance on the Mac Pro.
playnettimedemo id_demo001.netdemo
At the conclusion of the demo, drop the console down again and you’ll see the average frames per second for the timedemo. So how did OS X hold up to Windows XP? In my tests, which I repeated three times, it was fairly consistent: on average, OS X scored right around 72fps, while Windows XP cranked out 90fps. So, it seems for this one game at least, the OS X “it’s a better OS” performance tax appears to be a 20 percent framerate hit. That’s a definite ouch , but it’s perhaps not quite so bad in the real world of actual gameplay. Quake 4 caps the refresh rate at 60fps in game play, and during my testing on the earlier levels, I have yet to see it drop below that when playing at the 1440-by-900 resolution.
This difference should drop sometime in the future, too, assuming Quake 4 is patched to support the new multi-threaded OpenGL feature in OS X 10.4.8 on the Mac Pros. I’m not sure when, or if, we’ll see such a patch, though. In the short term, the game is very playable on the Mac Pro, even at somewhat higher resolutions. If you want the ultimate frame rate in Quake 4 on your Mac Pro, though, you’ll want to boot into Windows XP.
To demonstrate the playability of the game, I thought I’d redo the video from the report on the mini. So here’s that same hole at the same resolution (1024-by-768 originally), except on the Mac Pro. And since Snapz Pro now runs on the Intel Macs, this capture is of much higher quality.
Click the image to load the 2.2MB movie in a new window:
As you can see, the screen refresh was relatively quick and fluid. Given that TW2005 is one of my favorite quick-play diversions, I was glad to discover that it had acceptable performance, even under Rosetta. I still have my fingers crossed for a Universal update, but even if it never comes to pass, the game is playable.
Halo, Spider-Man 2, and Unreal Tournament: I discussed all three of these games in the original mini writeup in more detail. All three are Universal, and they all work wonderfully well on the Mac Pro. I ran a time demo in Halo, with every setting maxed out (advanced pixel shaders, 9x anti-aliasing, extreme lens flare, high model detail), and scored 43fps at 800-by-600. With the anti-aliasing dropped down to 4x and the lens flare to high, that number shot up to 112fps. In actual play, at 1440-by-900 resolution, the game is amazingly smooth and glitch-free.
That’s a take-off out of Telluride airport in Colorado, with some low clouds in the mountains. If you’ve ever been to the airport, then you know that this is basically the view off that end of the runway (though in reality, they typically take off in the other direction, wind permitting). Contrast the above image with the fog-shrouded view on the PowerBook from the previous report, and you can really see the payoff from the faster CPUs and video card.
Just for fun, I grabbed a Snapz movie of the entire timedemo—it’s only a few seconds long. You can watch either the full-size clip (1024-by-768, 2.4MB) or a smaller version (512-by-384, 1.2MB) if you’re on a slower connection. Note that because Snapz Pro movie capture requires a fair bit of CPU time itself, the frame rate in the above demo is “only” 538 frames per second (and I shot the movie at 15fps, to help minimize the CPU hit). I still think the video gives you a very good sense of the great speed at which the frames are rendered.)
Overall, the Mac Pro makes an excellent gaming machine. However, given its price point, it’s definitely not the most economical gaming machine you can buy. That said, if you’re a Mac user, you enjoy playing games, and your plans call for a new Mac Pro at some point, you won’t be disappointed by its gaming performance. While high-end PCs will still make better gaming platforms (thanks mainly to their ability to use multiple video cards to draw to a single screen), the Mac Pro isn’t a slouch by any stretch.
Three takeaway points
Testing the Mac Pro
You can see the results of Macworld Lab’s Mac Pro tests in our full review.
For this report, I didn’t duplicate those tests, but instead, chose to update the tests I ran for my report on the Intel-powered Mac mini.
GeekBench benchmark: In the period of time since I used GeekBench for the mini review, it’s been updated a few times. So I re-ran the benchmark on all my machines: the PowerBook G4 (1.25GHz, 768MB RAM), the Intel mini (1.67GHz Core Duo, 2GB RAM), the MacBook (2.0GHz Core Duo, 2GB RAM), the Dual G5 (2.0GHz G5, 2.5GB RAM), and the new Mac Pro (Dual 2.66GHz Xeon, 2GB RAM).
After all the crunching was done, here’s how everything came out:
ROB’S GEEKBENCH TESTS
Threads | PowerBook | Dual G5 | Intel mini Universal | MacBook Universal | Mac Pro Rosetta | Mac Pro Universal | Rosetta as % of Universal | |
---|---|---|---|---|---|---|---|---|
Emulate 6502 | 1 | 65 | 120 | 76 | 92 | 153 | 162 | 94% |
Multi | 65 | 240 | 153 | 183 | 607 | 645 | 94% | |
Blowfish | 1 | 119 | 128 | 136 | 163 | 127 | 233 | 55% |
Multi | 118 | 254 | 271 | 324 | 511 | 929 | 55% | |
bzip2 Compress | 1 | 91 | 125 | 123 | 147 | 137 | 224 | 61% |
Multi | 92 | 253 | 231 | 293 | 531 | 858 | 62% | |
bzip2 Decompress | 1 | 65 | 118 | 113 | 135 | 143 | 249 | 57% |
Multi | 67 | 248 | 232 | 278 | 597 | 1048 | 57% | |
Mandelbrot | 1 | 61 | 125 | 118 | 141 | 143 | 180 | 79% |
Multi | 61 | 250 | 235 | 282 | 568 | 718 | 79% | |
JPEG Compress | 1 | 100 | 119 | 92 | 110 | 123 | 159 | 77% |
Multi | 102 | 237 | 184 | 220 | 494 | 639 | 77% | |
JPEG Decompress | 1 | 81 | 127 | 84 | 101 | 125 | 150 | 83% |
Multi | 80 | 228 | 164 | 196 | 444 | 529 | 84% | |
Memory read sequential | 1 | 28 | 134 | 198 | 211 | 200 | 341 | 59% |
Multi | 29 | 113 | 169 | 177 | 21 | 168 | 12% | |
Memory write sequential | 1 | 80 | 166 | 235 | 227 | 339 | 487 | 70% |
Multi | 80 | 220 | 226 | 229 | 219 | 243 | 90% | |
OVERALL SCORE | — | 64.4 | 162.0 | 163.5 | 176.3 | 242.9 | 341.4 | 71% |
Testing was done with no other GUI applications running. The final column compares the Universal and Rosetta results for the Mac Pro, stating Rosetta’s figures as a percentage of the Universal figures. The higher the percentage, the better the performance under Rosetta as compared to native performance.
There are some interesting tidbits hiding in that table:
As I stated, this is definitely not a benchmark for measuring real-world usability—if it were, the G5 would have scored much higher than it did. What it does accurately reflect, however, is the power of the underlying processor(s) in each machine. In that sense, I find the results to be quite accurate. In my use of iMovie, for instance, I found that rendering transitions and effects took basically the same amount of time on the MacBook as it did on the Dual G5.
Cinebench benchmark: The free Cinebench benchmark uses the Cinema 4D engine to test the graphics performance of your Mac. It’s also available for Macs and PCs, so I tested everything I could. Back in March, that included my now-sold Athlon machine, so that’s still in the results table (as the benchmark hasn’t been updated, I felt it fair to leave in). I added my MacBook and the Mac Pro to the results, and with the Mac Pro, I included the results when running in Windows XP via Boot Camp—this to see if there were any platform-specific differences in the benchmark’s performance. When the dust settled, here’s how things came out (click the image for a much larger, easier-to-read version):
When I first published this chart, my old Athlon-powered PC was the champion, handily trouncing the G5 in the OpenGL tests, and basically tying it in the other areas. The Mac Pro put an end to that, and as you can see, by a wide margin. (I have no doubt that there are probably faster PCs out there—but I don’t have one available for testing). The PowerBook, as usual, is solidly in last place, as both the no-graphics-card MacBook and mini beat it out. I was pleasantly surprised to see no significant differences in the Mac Pro’s results regardless of whether it was running Windows XP (via Boot Camp) or Mac OS X—the XP box was about 2.5 percent quicker in the Open GL hardware test, and the Mac Pro was marginally quicker in all the other tests.
What that chart can’t show you is the visual difference between running the test on my Dual G5 and the Mac Pro. Though the G5 isn’t a slowpoke, the Mac Pro is over twice as fast when drawing the Open GL hardware-accelerated scene, and that kind of difference is obvious to the eye. As I’ve said many times before, the Mac Pro with the ATI X 1900XT video card is one fast machine.
Three takeaway points
Xbench: Although there’s a new version (1.3) of Xbench available, I was having some troubles getting what I felt to be believable figures from the program. One problem is that it doesn’t properly test for accelerated OpenGL graphics on machines (like my MacBook and mini) with a graphics chipset instead of a card. Also, I was getting very strange results on the “User Interface” portion of the test—the mini and the MacBook were both scoring about twice what the G5 was recording. Finally, the score for the Disk portion of the test on the G5 just seemed completely out of line—even testing on a newly-formatted drive, my score was roughly one-fifth of what it should have been for a stock G5.
Based on these odd results, I’ve chosen to hold off on any Xbench results until I can do some more testing with my machines (and hopefully, a new version is released that addresses some of the issues I experienced).
FireWire testing: As a new test this time, I thought I’d compare the time required to copy three sets of data (a single large file, a folder with tons of smaller files, and a small assortment of mid-sized files) to and from both FireWire 400 and FireWire 800 drives. I only tested the Mac Pro and the Dual G5, and I placed the three data sets to be copied onto a relatively clean (recently formatted) partition on each machine, then copied them from there to the FireWire drive. When copying the files back, I copied them back to a single partition on the Mac Pro (not the RAID 1 boot drive). Here’s what I found—the top figure in each cell is the number of seconds to complete the task, and the number below is the transfer rate in megabytes per second:
FIREWIRE PERFORMANCE TESTS
Copy to FW Drive | Copy from FW Drive | ||||
---|---|---|---|---|---|
Dual G5 | Mac Pro | Dual G5 | Mac Pro | ||
FW 400 | High def video clips | 196 30.3 | 207 28.6 | 172 34.5 | 170 34.9 |
Parallels disk image | 234 26.6 | 251 24.8 | 214 29.1 | 213 29.2 | |
iChat archives | 61 12.3 | 38 19.8 | 48 15.6 | 32 23.5 | |
FW 800 | High def video clips | 115 51.6 | 125 47.4 | 139 42.7 | 113 52.5 |
Parallels disk image | 168 37.0 | 156 39.9 | 145 42.9 | 141 44.1 | |
iChat archives | 53 14.2 | 32 23.5 | 40 18.8 | 29 25.9 |
In each cell, the top figure is seconds and the bottom is megabytes per second. Best results in red
High-def video clips: 37 HD movie trailers organized into five folders, totaling 5.93GB. Parallels disk image: The Windows XP virtual drive for Parallels, 6.22GB in size. iChat archives: 10,026 files organized into 125 folders, plus 668 unfiled items, totaling 750.7MB in size.
This is obviously a far-from-complete test, and I didn’t do everything necessary to control all the variables as would be necessary in a real performance evaluation. Still, there are some interesting results to consider:
Overall, FireWire seems to work about as well on the Mac Pro as it does on the Dual G5—at least when copying to or from internal drives. I’ve heard a report that copies between FireWire drives on the various buses are slower on the Mac Pro, and I plan on doing some testing in that area for a future report.
Three takeaway points
Rosetta and Intel transition issues
As I look back on what I wrote in the spring in this section of the mini’s report, I still think my general conclusions drawn back then are still true today—just a bit less so (in a good way!) in some regards.
Regarding Rosetta, I wrote:
For most typical users, who spend their time in e-mail, on the web, and working on simple letters and spreadsheets, I don’t think Rosetta is going to be noticed much, if at all. If, on the other hand, you’re a power user who works on massive Excel spreadsheets, huge image-laden Word documents, or monstrous 20MB advertising layout TIFFs in Photoshop, you’re going to want to wait for native versions of your applications before you switch.
That’s definitely still a true statement today, but the speed of the Mac Pro means that even a non-native Photoshop isn’t an excessively slow Photoshop—as long as you’re working with reasonably sized images. For most remaining Rosetta apps, unless they’re doing something special with graphics, you probably won’t even notice that they’re running in Rosetta. Apple realized early on that Rosetta would be the key to a successful Intel transition, and it seems to me like they’re gotten it pretty much right. I’m still astounded that something like Tiger Woods PGA Tour even launches in Rosetta, much less runs at a semi-decent frame rate.
Regarding that Intel transition, back in March I wrote (about the mini):
At the end of the day, the mini is really just another Mac, regardless of what’s powering it. If nobody told you, you wouldn’t know there’s anything different under the hood. The machine is a Mac, just one with a different engine powering it than we’re all used to.
Of course, we’re now completely transitioned to Intel, and some models are already into their second generation. I think anyone who has used an Intel Mac will tell you that it’s still got the soul of a Mac. It still runs OS X. It still works with peripherals as well as it always has. Sure, some things have changed under the hood, but the machines are still Macs. Back in March, I lamented the lack of both Snapz Pro and SideTrack, but now, both are available for the Intel Macs. In March, we had about 1,000 Universal applications to pick from. Now that figure is well over 4,000.
The combination of Apple’s industrial design and Intel’s speedy chips has created some of the fastest, most expandable, and least expensive Macs that we’ve ever seen (more on that in a minute). If I had to grade the Intel transition, I’d probably have to give Apple an A- or a B+, as there’s not much to fault them on. Sure, a native Adobe suite would’ve been nice to have, but beyond that, I feel the transition has gone much better than I expected. For my takeaway points, I’m going to repeat two from the spring, and add one new one.
Three takeaway points
Conclusion
As I write this, I’ve had the Mac Pro for almost exactly one week. It’s been a busy week, with lots of shuffling between the two machines (they’re on opposite sides of the desk at the moment), and lots of file copying (and recopying) and system updating (and re-updating). Through all of that, I’ve been impressed with the Mac Pro’s quietness and speedy operation. Assuming Macworld bought everything on my machine through the Apple store, it retailed for $3,126 (2.66GHz model with 2GB of RAM, Bluetooth, AirPort, one 250GB drive, and the ATI X1900 XT video card). While that’s not an insignificant amount of money, I would argue that it’s an amazing value on two different fronts.
First, there’s just the raw value of the machine. Compared to my Dual G5, prices have dropped tremendously (as they generally do in computing). I ordered my machine on June 23, 2003, in this configuration:
For all of that, I wrote Apple a check for $3,299. Adjusting for inflation, that would be $3,638 in today’s money. So for $500 less, I have a machine with twice as many processors (and those processors are much faster), a larger and faster (SATA 2) hard drive, a much better video card, a faster SuperDrive, room for three more (instead of one more) internal drive and a second optical drive, Bluetooth, AirPort… and no modem. Clearly today’s Mac Pro contains a lot more technology for a lesser cost.
Second, there’s the “two mints in one” value of the Mac Pro. It’s not just that that Mac Pro is an excellent OS X box. It’s also a very capable Windows XP machine. If I had a “real” job, this one machine could easily take the place of two—consider a graphic designer who has to use some corporate Windows XP-only application, for instance. So instead of having two huge boxes sitting on their desk, the designer would have just one, and use either Parallels Desktop or Boot Camp for when they needed access to Windows XP.
So there you have it, my in-depth look at the Mac Pro. And now it’s time to actually finish my data migration, which I’d set aside to complete this report. I can’t wait to make the switch, and move the Mac Pro into its permanent spot on my production line. The Dual G5 will become some sort of home server, though I’m not quite sure in what regard just yet—perhaps that project will be the subject of a future report.
[ Rob Griffiths is a senior editor at Macworld.]