java - AWS SQS Batch SendMessageBatchRequest 非常慢

Question

我的应用程序使用 SendMessageBatchRequest 向 AWS-SQS 发送 10 条消息。每条消息的大小小于 250 字节。该应用程序预计每天发布大约一百万条记录。但是消息发布的速度非常慢，无法实现这一点。

AmazonSQS sqs = null;
sqs = new AmazonSQSClient(new BasicAWSCredentials("accessKey", "SecretKey"));
//the below entries are added via a for loop picking the messages from a queue
//the typical queue size will be 20k messages
//AmazonSQSClient is created once and is used until the code comes out of the for loop

List<SendMessageBatchRequestEntry> entries = new ArrayList<SendMessageBatchRequestEntry>();
entries.add(new SendMessageBatchRequestEntry(messageBatchRequestId, "250kbJSONString"));
 //Once the batch count reaches 10,the following code is called 

CreateQueueRequest createQueueRequest = new CreateQueueRequest("CLIENT-TEST");
String myQueueUrl = sqs.createQueue(createQueueRequest).getQueueUrl();

SendMessageBatchRequest sendMessageBatchRequest = new    SendMessageBatchRequest(myQueueUrl);

sendMessageBatchRequest.setEntries(entries);
long timeBeforePost = System.currentTimeMillis();
SendMessageBatchResult smbResult = sqs.sendMessageBatch(sendMessageBatchRequest);
long afterPost = System.currentTimeMillis();
log.trace("time taken %s ",(afterPost-timeBeforePost));

捕获每个帖子所花费的时间，这是典型的输出

time taken 57
time taken 37
time taken 31
time taken 322
time taken 48
time taken 153
time taken 278
time taken 86
time taken 35
time taken 28
time taken 30
time taken 57
time taken 43
time taken 314
time taken 5587
time taken 42
time taken 4789
time taken 4831
time taken 66
time taken 6239
time taken 50
time taken 38
time taken 4833
time taken 40
time taken 4896
time taken 27
time taken 16634

有些帖子需要 7,16 秒才能返回，这是否正常？我有一些帖子需要 300 秒才能从方法调用返回。我在这里遗漏了什么吗，我的应用程序目前是单线程的，我是计划使其成为多线程以并行处理消息，但有些消息需要几秒钟，有些需要数十/数百秒，这是严重错误的。请帮忙。

非常感谢

Answer 1

我的第一个猜测是您的本地计算机和 SQS 之间存在延迟问题，SQS 处理传入消息的速度肯定比您看到的数字快得多。

也许最好的办法是启动一个 EC2 实例几个小时，使其大小与您的本地计算机相似，然后进行相同的测试以查看问题是否消失。