Fraser Speirs Cocoa and Photos

Posted
16 July 2008 @ 12pm

Tagged
Business, Programming, Tech

Add:     

App Store Review is broken

It’s well known that there is a process of review that happens when a developer submits an application to the iPhone App Store. At the iPhone SDK launch, it was claimed that this was to prevent “bad” applications reaching users’ phones. The problem was that “bad” was and remains loosely defined. Those pornographic applications, virii and “bandwidth hogs” were to be filtered out before unsuspecting users could download them. Fine. In theory.

The problem that I and others are having right now is that it doesn’t scale. Apple requires that every single update to every app go through the same vetting process (although who knows exactly what this involves?). I submitted Exposure 1.0.1 to the App Store last Friday and, five days later, one version is “In Review”. The other is still, mysteriously, “waiting for upload”, even though I already did.

If Apple can’t guarantee a maximum 24 hour review process, they should drop it. What would happen if I was trying to correct a data loss or security bug, and the update sits in App Store limbo for five or ten days? Fortunately I’m not facing that situation, but these are fixes for painful crashing bugs that are really affecting users of Exposure. All the while, users continue to comment negatively on these already-fixed-but-not-released bugs in Exposure’s reviews on iTunes. Without demos, those reviews are an app’s lifeblood.

I can understand Apple wanting to check new applications, but holding up bug fix releases for five days or more is both annoying to users and damaging to developers’ reputations.


13 Comments

Posted by
John Keogh
16 July 2008 @ 3pm

I got some application updates, including NetNewsWire, at 11:20 this morning. However all the new .ipa files are the same size as the previous versions. Doing a version check on NetNewsWire from within iTunes shows version 1.0.


Posted by
Anoop Ranganath
16 July 2008 @ 3pm

I submitted an updated Graffitio _before_ the App Store even went live, and I’m still waiting on it to appear. Ugh.


Posted by
Robert 'Groby' Blum
16 July 2008 @ 6pm

Welcome to the wonderful world of embedded devices. If you want to see where this is heading, look at Console games - elaborate procedures and tests to satisfy before you can ship anything.

And I actually like it that way - I don’t want updates that might or might not crash, I want solid testing. (Then again, looking at some of the things in AppStore, that’s not what Apple is doing either…)


Posted by
Virtuous
17 July 2008 @ 7pm

Console makers do a poor job of testing games. Apple isn’t doing any better. Of course we expect Apple to do better than mere mortal companies. There are bugs in the 2.0 software update too. The camera on my 2.0 upgraded iPhone no longer works properly. Photos look like they’re completely out of focus. I soft-reset my iPhone and bricked it. Had to restore everything via iTunes from my Macbook. This didn’t happen before I installed 2.0.


Posted by
Annoyed
17 July 2008 @ 11pm

It’s worse than that, unfortunately.

Apple is, it seems, deciding whether they even like the design of your app at all. Without giving out too much info, it seems they are dictating how the app looks. So, this begs the question - why don’t they just design the app for us, and then we can develop it? Would save us all a lot of trouble….. Or maybe they could adopt the same practice as every other manufacturer - and just certify the app to ensure it doesn’t break the phone, or use too much bandwidth? And leave the app design to the people who know best - the developers.


Posted by
flo
18 July 2008 @ 12am

@ Annoyed Care to share what exactly you tried to submit that leaves you with that conclusion?
Because seriously, if you look at the apps that got through (bad design: triplog), ip telephony (not sure what the app name is) and tons of ebooks/flashlight apps etc, I really don’t see how apple is “weeding out”.


Posted by
Annoyed
18 July 2008 @ 12am

@flo - Sorry, but I can’t say (it’s for a customer and it’s all secret squirrel stuff right now). But I agree - seeing some of the cr@p that’s got into the store, I really don’t understand what their methodology is for weeding out either.

Apple need to be a little more transparent and let developers know in advance what their criteria is, and then we wouldn’t waste time having to pander to their whims.


Posted by
Jaffa
18 July 2008 @ 10am

I just got a notification that Exposure (the free version, natch) has been updated, but it still says 1.0 and has no release notes. Has it really?


Posted by
Opera Row
18 July 2008 @ 12pm

You are one of the lucky ones. At least you got your app published!

Me and a partner invested months of our lives and thousands of dollars into developing an app, and now it is “in review” weeks (!) on end. Mails to Apple don’t get answered, no information on the status of the app in the review pipeline, nuttin.

In the meantime a similar product appeared of which I know (the developer says on his site) that it was submitted AFTER ours.

I am no fan of conspiracy theories. But one could suspect that it’s not “first come, first serve”, but Apple Engineers holding stuff back on purpose. Maybe waiting till their buddies’ apps are ready to go live?

AAPL has become evil.


Posted by
Pierre Bernard
18 July 2008 @ 3pm

ACTGratuity 2.0 has been under review for 7 days now and counting…

This hasn’t prevented Apple from publishing the updated description and screenshots within 12 hours of the upload. Made for some verrrrry angry customers!

Lesson learned: update the description only once you receive confirmation that your update went live!


Posted by
Stevew
18 July 2008 @ 6pm

I agree with what you’re saying but there’s something in your post that just makes me cringe every time I see it: virii.

I don’t want to sound like a nit-picker but the word doesn’t exist (although, ironically the word has spread like a virus on the internet). The plural of virus is ‘viruses’.


Posted by
Robert 'Groby' Blum
19 July 2008 @ 1am

@Virtuous: Compared to Apple, they do a marvelous job of testing. Yes, bugs in games slip through, but believe me, certification for any of the major consoles is not a thing you easily pass. Where it excels over Apple is that there’s a well-documented list of tests you have to pass.

Apple, on the other hand, seems to keep the criteria completely secret.


Posted by
Annoyed
19 July 2008 @ 2am

@Robert: So secret, in fact, that not even the Appletards running the process know what the criteria is. And in any case the criteria seems something of a moving target anyway.

It’ll all change when Android eventually launches, and everyone’s attention shifts to another “open platform” - then maybe Apple will relax their iron grip on the process, and stop trying to run everyone else’s business.