The battery life was the most important thing...just to leave the DoCoMo in your bag and forget about it, and not have to fiddle with it to get it to work.
Signal strength This was very adequate--I got good WiFi strength in the same room and even the next room. This would not be a good device to provide internet to an entire house, but the effective range was more than reasonable--working through two walls in one case just fine.

Speed The average peak was about 200kbps, it was slightly more in some places and less in others, depending on signal strength and traffic. However, I found Japan's 3G signal and wireless speeds to be much more consistent than what we have in the United States.

Location On subway / trains: Most of japan's underground subway stations have reception. However, the subway tunnels do not. While riding the shinkansen, I was able to get reception on the entire Tokaido line without problems. A key exception was while traveling through tunnels, but these were relatively few and far between, and the device had little problem reconnecting to the network on its own after the tunnels had passed.

Applications Mobile devices: I found the device perfect for use with mobile devices such as the iPad and iPhone. Without having purchased AT&T's international internet access package, which can be hundreds of dollars for a very limited data budget (in the low hundreds of megabytes), I wasn't able to get any signal on my iPad. However, using the pocket WiFi device, I was able to have unlimited high speed internet access basically anywhere in Japan. A google maps page load, for example, can take about three megabytes to load the map/directions between two given points. With the device, I was able to use my phone to look up directions and find out where I was—even though the GPS in apple devices is supported by cell tower locations, GPS worked beautifully on the iPhone and iPad when using the pocket WiFi device—for example, the iPad was able to track my route on surface trains and the Shinkansen in real time. Though some knowledge of Japanese is required (since the names of the stations and train lines were displayed in Japanese), it is possible to use Google Maps' public transportation directions feature to plot a route and itinerary for the Tokyo Metro or JR lines using the iPad, iPhone, or a computer. In fact, using the pocket WiFi device extended the battery life of my iPad and iPhone over what they would have in the US, since WiFi takes less power than the 3G modems built into those devices.

Multiple devices I had no problem connecting four devices to the WiFi spot at once--the internet speeds were fast enough to support reasonable browsing on all devices.

Email and surfing The device was perfect for this, the surfing experience was nearly as good as some wired broadband connections in the US. Pages loaded quickly, push email worked great.

Video streaming The speeds were sufficient to support video streaming from sites like YouTube, or with a sufficiently fast proxy, Hulu (that service is not available from a Japanese IP address due to streaming rights issues).

Exchange I was able to sync with my Exchange server using the device.

VPNs I was able to get onto my school VPN in order to access academic literature I needed to read while abroad.

VoIP I did not get to use VoIP on the device, sadly. I suspect that it would work well, though--I'd recommend testing it out with Skype to see if calls could be sent and received.

 
NTT DoCoMo DWR-PG Buffalo Router vs. HuaWei E5830 Router
1. NTT DoCoMo DWR-PG Buffalo Router
I didn't get to use this device for a long time, but I felt it was a lot better. Though it would be a bit tougher to fit in a pocket, the battery life was significantly better, as was the ease of use. To use, one just had to power the device on. The other button on the device confused me, and I never figured out what that was for. The two USB plugs on the included cable also confused me--some instruction on that would have been useful. I never had to touch the software, though, and I think that was for the best.

My impression was that speeds were better on this device. The battery life was the most important thing, and I think you'll get much better customer satisfaction with this one than with the other one since it's much more possible just to leave the DoCoMo in your bag and forget about it, and not have to fiddle with it to get it to work.

2. HuaWei E5830 Router
Form factor: about as big as a credit card, and a bit thicker than an iPhone. it could fit in a pocket just fine, or a messenger bag / briefcase.

Usage: To turn on the device, I had to hold down the power button, wait for the device to boot up, then hold down the Internet connect button, and wait for a solid blue indicator 'M' to light up. Then, holding the WiFi button, a solid blue W indicator would appear. After that, it was fairly simple to find the correct network (per the instructions) on my Wi-Fi enabled device, and enter the password at the prompt in order to be connected. The only issue was that it was not always clear when the device had finished booting up after first starting the device--the indicator lights would sometimes seem to show that the device was idling while in fact it was still booting up and therefore not responsive. I think it would be helpful to create a custom instruction booklet or laminated card with step-by-step instructions for users, which explain the different indicator lights and that the user should wait 30-45 seconds after booting up the device to connect it to the internet / broadcast the signal.

Battery life: Battery life on the device was about two hours. This is not two hours of use, this was two hours of continuous operation whether or not the internet was actually being accessed. I was able to extend the effective battery life by turning off the WiFi broadcasting and the internet connection, leaving the device in idle mode. This, however, requires the device to be easily accessible every time one makes this adjustment, and the process takes about fifteen seconds, which is not insignificant while moving around on a busy subway system like Tokyo's. With the Huawei device it would be less useful for receiving calls due to the short battery life.

 
These tests were conducted throughout Japan during June 2010. The report was kindly provided by:

Justin Chung
Department of Informatics at the Bren School of Information and Computer Sciences
University of California, Irvine
2008 Graduate of Stanford University with a degree in Management Science and Engineering.

We appreciated his assistance!
 

For more information, see: http://jcrcorp.com/mobile/mobile_rental_wifi_router.htm