ios - 苹果 TestFlight : Is it allowed to upload 2 beta apps for an A/B test?

Question

我需要通过 Apple TestFlight 为 iOS 8 应用运行 Beta 测试。是否允许上传 2 个版本的 Beta 应用程序进行 A/B 测试？ (我想切换应用程序图标和其他一些东西，以检查哪些更适合用户。)

---

赏金注意事项:

Especially interested if there are any experiences with submitting two similar builds for external testing, as builds have to go through the (albeit lighter) review process.

I would presume it would be OK, as one can submit freeform notes for the reviewers and explain the situation—AND because, in any case, externally tested apps have to go through the normal App Store review process before going live; so acceptance in external testing wouldn’t be a free ticket to App Store.

But these are just my assumptions and hence the bounty. Has someone done this? With negative or positive results? Or both—review processes are notoriously independent and, at times, arbitrary.

I’m not interested in interpretations of review guidelines, but how they are executed in practice.

Or should this all be handled inside the app with some A/B testing framework? (Which is unfortunately more work than just creating two bundle IDs… And this wouldn’t help in testing the app icon)

Answer 1

为了在测试中有 2 个事件构建，您需要 2 个应用程序(不同的包 ID)，您唯一的选择是通过相同的帐户或不同的帐户。在同一个帐户中处理起来更容易，管理的上下文切换更少。

我们都成功地做到了，Apple 没有提出任何问题。我们也没有在评论说明中特别提及。

最终您的帐户中会出现更多死掉的项目，但这只是您的问题，Apple 不会提示。

为什么艰难

A/B 测试可以在同一个构建中完成，但您提到的某些内容除外(应用图标)。通常这是通过艰难的调查来处理的。

拥有 2 个应用的唯一优势是所有用户都可以在您的 A/B 测试中测试两个版本，因为他们愿意花时间测试这两个版本。

想到的缺点:

• 您迟早会杀死其中一个版本，可能会失去一些只选择该版本的 Beta 测试人员。由于您在发布应用商店版本后可能不需要 Beta 测试人员这一事实而得到缓解
• 您将无法控制谁拥有哪个版本以确保正确分发并将用户从一个版本转移到另一个版本，除非您准备好与您的 Beta 测试人员进行大量沟通。