Mobile App Testing

By now, nearly everyone has heard THE BIG NEWS about Instagram getting sold to Facebook for a cool $1 billion. You’ve probably also seen the news about Instagram being launched on the Android marketplace, having previously been exclusive to the iPhone. What you may not have noticed is that it’s Android launch has not gone as smoothly as some might have hoped for – and not because some iOS users are jumping ship. The real reason: fragmentation.

Readers of this blog are quite familiar with the fragmentation of the Android ecosystem (i.e. numerous combinations of devices, operating systems and carriers), which makes bugs incredibly hard to diagnose and fix.

CNET Asia posted a brief summary of a few issues in particular. Take a look:

If you haven’t heard, Instagram, the popular social networking app for sharing pictures, is now available for Android. We tried loading it on HTC’s latest wonder phone, the One X, in order to put its fantastic camera to the test. Unfortunately, as you can see above, the app just doesn’t quite work. In fact, we’re not the only ones who have noticed this.

According to Gotta Be Mobile, Temple Run also suffered from the same issue of not working properly on certain devices. Google’s continued insistence that Android is not fragmented just looks silly at this point, especially when you consider the fact that only 2.9 percent of handsets are running Ice Cream Sandwich. The OS was released late last year.

Comparatively, 80 percent of iOS users are running on iOS 5 or later, according to statistics obtained by Indie developer David Smith.

Other sites, such as geek.com, have made note of forced close on the Glaxy Nexus and the Nexus X. I’m sure there are many other similar instances as well.

In any event, as Instgram expands its footprint (to Windows Phone perhaps?) it will be interesting to see what approach it takes to testing. Stay tuned.

SEO has been a buzz word for a good few years now, but that’s old news. Now it’s all about ASO, “App Store Optimization.”

Until now the best way to score app downloads was to be featured in one of the app stores. And to do this you either A. had to be getting a ton of downloads anyway or B. have an amazing app that happened to get picked up by the people running the store and highlighted in the featured apps area – not an easy feat. But now a new movement of optimizing apps for search is getting into full swing. I wrote a few months ago about optimizing your app name for easier on-device searching (after it’s already been downloaded). Now that concept of app optimization is being put into practice with an eye toward app store searches, this time targeting the keywords used to describe an app. From TechCrunch:

With over 600,000+ iOS applications, and now some 450,000 on Android, the real challenge for developers is having their app surfaced higher than hundreds of other competitors in the app store search results. Doing this correctly involves ASO, or app store optimization. It’s basically SEO repurposed for mobile….

Read more…

According to PCMag and other reports, Amazon is in the process of testing a new service that lets Kindle Fire users make purchases through mobile applications. Here are the details:

Google and Apple already provide in-app purchasing capabilities. Google launched in-app billing for Android apps in March 2011. In-app purchases have been available via Apple’s App Store since October 2009 and via BlackBerry App World since September 2010.

In-app purchases are expected to generate $5.6 billion in revenue by 2015, up from $970 last year, according to January stats from IHS iSuppli.

Users “overwhelmingly” prefer free apps over paid apps, and it’s becoming increasingly difficult for developers to justify charging an upfront cost for their apps with so many free options available, Jack Kent, senior analyst, mobile media for IHS, said in a statement. For this reason, developers are increasingly turning to in-app purchases as a way to monetize their apps. IHS predicts that soon, the dominant app monetization strategy will be to offer apps for free and then charge for in-app content.

Read the rest >>>

It’s no secret that the vast majority of apps exist in within the app stores of iOS and Android. It’s somewhat of a secret, however, that most of the major apps are also available in the Windows Phone marketplace. Not all, but most. To help get this point across, CNET.com recently posted the following chart:

As a WP7 user, I should point out that Google Maps is available (I have it on my device) and that Gmail can be synched with the Linked Inbox. The one that kills me is Pandora.There’s no excuse for that. Anyway….

Read the rest here >>>

Do you rely on your TomTom GPS to get you from Point A to Point B? Well, you may want to buy a car atlas as a backup (which is actually good advice in general).

It appears that some TomTom devices haven’t coped too well with the extra day in leap year. An as-yet-specified issue is keeping these devices from pinpointing locations correctly. The bug only reared its ugly head a few days ago and the TomTom people have found a temporary fix, but they’re still working on the issue at large. Here’s a few more facts from engadget:

[TomTom] confirmed today that a leap year bug is preventing at least some models from obtaining a GPS position — something that has apparently been occurring since March 31st. Exactly which GPS devices are affected isn’t clear, with TomTom only saying that a “limited number of models” have been experiencing the problem. Unfortunately, the company doesn’t have a permanent fix just yet, but it says that a hard reset of the device will temporarily resolve the issue if you find yourself in a pinch.

Update:

TomTom has idenfied the issue and released an update for fix the bug. From PCWorld:

Satellite navigation maker TomTom has pushed out an update to fix a software glitch that left customers worldwide complaining about not being able to find their location.

Today the Dutch company apologized for the glitch, which it said was caused by a “leap year” bug in the GPS receiver software from a third-party supplier.

“A software update fixing the issue is now available via MyTomTom,” it said in a statement, directing owners to a support Web page. “The update is straightforward.”

Reviews are a mainstay of the mobile world. It seems that nearly every publication worth its weight in data is publishing them for just about every major launch. But did you ever wonder how they go about such a process? Well, the writers over at DigitalTrends.com were kind enough to share their mobile review protocol. If you read it with the right set of eyes, you’ll spot a few great mobile app testing tips.

Here are a few good excerpts:

Unboxing
The first thing we generally take a look at, but rarely report on, is the boxing. We check how well the phone is boxed up and what cables and doodads the manufacturer has included in the box. Usually, it’s just a charge cord, but occasionally, manufacturers get generous. Unboxing does not heavily factor into the review process unless a vital component is missing or inadequate.

Design and feel
The first thing we note about a device is how good it looks and how well it appears to be made. We attempt to decipher what materials the casing and other components are made out of, how sturdy (and reflective or fingerprint resistant) the screen is, how heavy the entire phone is, how easy it is to access the battery, and the general placement of key buttons, ports, and other physical attributes.

Operating system
Having a phone that looks good and feels great is one thing, but if it’s running a poor or outdated operating system, then it might as well be a $700 paperweight. We’re intimately familiar with every major smartphone operating system, from Android to iOS to webOS, and even BlackBerry and Windows Phone. We know them all, and we know our history too – Windows Mobile, Series 40, Series 60, QNX, Zune, iPod, Palm, Treo, Brew, we’ve used them all.

Camera
While a smartphone camera certainly doesn’t compare to a DSLR, more and more people are using their phones as their primary camera. As such, we’ve ramped up our testing of smartphone cameras in the last year. We have a standard set of shots that we take with each device, including macro, landscape, portrait, outdoor, indoor, night, low lighting, and shots with the LED flash (assuming the device has one).

Read more…

Some six months ago Apple warned app developers that pulling UDID information (the unique identification number tied to each Apple device) was soon going to be a no-no with iOS 5. The company said it would “deprecate UDIDs” because of privacy concerns. Nothing more was really said about it. Then, late last month, app developers began receiving these rejection notifications:

TechCrunch explains why Apple is now limiting access to UDIDs and who it’s effecting most:

Amid extra scrutiny from Congress around privacy issues, Apple this week has started rejecting apps that access UDIDs, or identification numbers that are unique to every iPhone and iPad. …

Read more…

Do you play games on your SEMC Xperia Play? Are you a news junkie with an LG Optimus 2X? How do sports apps work on your Samsung Infuse 4G? Ever get frustrated with the music app on your HTC Thunderbolt? In our newest uTest Infographic we let the Android Market app reviews do the talking to find out which devices reign supreme (and which fall flat) in the  major app categories.

Sure, you might belong to a testing group on LinkedIn and Facebook and follow all the top testers on Twitter. But for the lighter side of social media for software testers here are some funny, informative and visually appealing Pinterest boards focused on testing:

Funny Images

“Software Testing” by Claire features a mix of cartoons and memes

Adrienne focuses her Software Testing board on the pressure of testing

Informative

Ina has links to helpful tips about Software Testing

Gregory collects mobile news in a visual way

Here’s a UX Mobile Design board by Quentin

Mobile data graphs can be found on TJ’s board

Infographic Boards

NTT Data’s board has some helpful links and lovely infograpics

Natascha has some great mobile infographics

More infographics from inQbation Web Design, this time focused on apps

Andrew presents infographics focused on mobile social media

A nice mix of images, infographics and graphs about everything mobile by Kellyn

(And Ken presents a whole different kind of app testing.)

When you’re testing a mobile app, you’re looking for things like functionality, usability and security. You probably form your own opinion of the app and maybe even compare it in your head to other, similar apps – but that’s not an official, reportable part of testing. Well, today we’re going to satisfy that human need to compare things.

Let’s start with PCWorld‘s comparison of mobile search apps from Google, Bing and Yahoo on Android. Here’s what they came up with:

Interface, Tools, and Navigation

Bing’s Beauty
Bing’s appeal is obvious from the moment you launch the app: Its full-screen interface is gorgeous. The app highlights the same image of the day on the desktop version of Bing. A list of search options runs down the screen, allowing you to choose from among images, videos, maps, local, deals, movies, news, shopping, and directions. …

Every Bing screen includes a search query bar at the top. You can enter a query by typing it, or you ca