服务器 Gind.cn
  1. 服务器 Gind.cn
  3. AWS SNS发送太多通知
Intereting Posts
使用letsencrypt的LDAP TLS错误 在Debian Squeeze上将SVN更新为1.7 有RDDtool的任何.NET替代品吗？ 我有一个Excel 2010的KMS / MAC密钥，我可以在哪里下载媒体？ 将parameter passing给Gearman工人 如何杀死一个失控/stream氓剪贴板粘贴到CLI？ 我如何build立一个文件服务器，我们可以在Linux中增量增长？ 在ETL故障期间设置自动调用 将我所有的域计算机移动到另一个域 购买新的IBM Blade。 考虑到重型IOPSconfiguration的SSD 来自地址的电子邮件发送脚本无效 Web服务器显示IP地址而不是域名 为什么我们不能将GPO链接到AD容器？ 我应该给我的注册商NS或SOA哪个地址？ 是否有可能创build排除服务器的GPO？

AWS SNS发送太多通知

问题

一句话

SNS Topic向HTTPs用户发送太多通知。

更详细

我已经在我的一个S3存储桶中启用了事件，并且通过HTTPS将我的一个应用程序订阅到了它的SNS Topic 。 一切都很好，直到今天，当我的应用程序开始花太长时间回应。

在重新启动EC2实例并注意到问题仍然存在之后，我SSH到了EC2实例，并意识到我几乎立即连接了，命令正在执行，没有明显的延迟。 所以我知道问题不在实例networking中。

我去检查Apache日志，那是当我注意到每秒数百（或许数千）的POST请求。 查看下面的日志片段。

问题（S）

  • 有没有办法看到是否将S3发送所有这些通知事件到SNS？

  • 另外，这可能是S3每秒接收很多上传，甚至可能吗？

  • 最后，我可以做些什么来阻止这个，而不是简单地退订这个话题？

Apache日志： 

 72.21.217.87 - - [02/Mar/2017:15:33:52 -0500] "POST /notifications HTTP/1.1" 500 619 "-" "Amazon Simple Notification Service Agent" 72.21.217.133 - - [02/Mar/2017:15:33:52 -0500] "POST /notifications HTTP/1.1" 500 6404 "-" "Amazon Simple Notification Service Agent" 72.21.217.141 - - [02/Mar/2017:15:33:52 -0500] "POST /notifications HTTP/1.1" 500 619 "-" "Amazon Simple Notification Service Agent" 72.21.217.139 - - [02/Mar/2017:15:33:52 -0500] "POST /notifications HTTP/1.1" 500 619 "-" "Amazon Simple Notification Service Agent" 72.21.217.75 - - [02/Mar/2017:15:33:51 -0500] "POST /notifications HTTP/1.1" 500 619 "-" "Amazon Simple Notification Service Agent" 72.21.217.182 - - [02/Mar/2017:15:33:52 -0500] "POST /notifications HTTP/1.1" 500 619 "-" "Amazon Simple Notification Service Agent" 72.21.217.137 - - [02/Mar/2017:15:33:52 -0500] "POST /notifications HTTP/1.1" 500 619 "-" "Amazon Simple Notification Service Agent" 72.21.217.157 - - [02/Mar/2017:15:33:52 -0500] "POST /notifications HTTP/1.1" 500 619 "-" "Amazon Simple Notification Service Agent" 72.21.217.161 - - [02/Mar/2017:15:33:52 -0500] "POST /notifications HTTP/1.1" 500 619 "-" "Amazon Simple Notification Service Agent" 72.21.217.139 - - [02/Mar/2017:15:33:52 -0500] "POST /notifications HTTP/1.1" 500 619 "-" "Amazon Simple Notification Service Agent" 72.21.217.156 - - [02/Mar/2017:15:33:52 -0500] "POST /notifications HTTP/1.1" 500 6404 "-" "Amazon Simple Notification Service Agent" 72.21.217.70 - - [02/Mar/2017:15:33:52 -0500] "POST /notifications HTTP/1.1" 500 619 "-" "Amazon Simple Notification Service Agent" 72.21.217.135 - - [02/Mar/2017:15:33:52 -0500] "POST /notifications HTTP/1.1" 500 619 "-" "Amazon Simple Notification Service Agent" 72.21.217.152 - - [02/Mar/2017:15:33:52 -0500] "POST /notifications HTTP/1.1" 500 619 "-" "Amazon Simple Notification Service Agent" 72.21.217.113 - - [02/Mar/2017:15:33:52 -0500] "POST /notifications HTTP/1.1" 500 619 "-" "Amazon Simple Notification Service Agent" 72.21.217.83 - - [02/Mar/2017:15:33:52 -0500] "POST /notifications HTTP/1.1" 500 619 "-" "Amazon Simple Notification Service Agent" 72.21.217.158 - - [02/Mar/2017:15:33:52 -0500] "POST /notifications HTTP/1.1" 500 619 "-" "Amazon Simple Notification Service Agent" 72.21.217.129 - - [02/Mar/2017:15:33:52 -0500] "POST /notifications HTTP/1.1" 500 619 "-" "Amazon Simple Notification Service Agent" 72.21.217.75 - - [02/Mar/2017:15:33:52 -0500] "POST /notifications HTTP/1.1" 500 619 "-" "Amazon Simple Notification Service Agent" 72.21.217.156 - - [02/Mar/2017:15:33:52 -0500] "POST /notifications HTTP/1.1" 500 619 "-" "Amazon Simple Notification Service Agent" 72.21.217.64 - - [02/Mar/2017:15:33:52 -0500] "POST /notifications HTTP/1.1" 500 619 "-" "Amazon Simple Notification Service Agent" 72.21.217.134 - - [02/Mar/2017:15:33:52 -0500] "POST /notifications HTTP/1.1" 500 619 "-" "Amazon Simple Notification Service Agent" 72.21.217.130 - - [02/Mar/2017:15:33:52 -0500] "POST /notifications HTTP/1.1" 500 619 "-" "Amazon Simple Notification Service Agent" 72.21.217.86 - - [02/Mar/2017:15:33:52 -0500] "POST /notifications HTTP/1.1" 500 619 "-" "Amazon Simple Notification Service Agent" 72.21.217.167 - - [02/Mar/2017:15:33:52 -0500] "POST /notifications HTTP/1.1" 500 619 "-" "Amazon Simple Notification Service Agent" 72.21.217.135 - - [02/Mar/2017:15:33:52 -0500] "POST /notifications HTTP/1.1" 500 619 "-" "Amazon Simple Notification Service Agent" 72.21.217.169 - - [02/Mar/2017:15:33:52 -0500] "POST /notifications HTTP/1.1" 500 619 "-" "Amazon Simple Notification Service Agent" 72.21.217.76 - - [02/Mar/2017:15:33:52 -0500] "POST /notifications HTTP/1.1" 500 619 "-" "Amazon Simple Notification Service Agent" 72.21.217.75 - - [02/Mar/2017:15:33:52 -0500] "POST /notifications HTTP/1.1" 500 6404 "-" "Amazon Simple Notification Service Agent" 72.21.217.79 - - [02/Mar/2017:15:33:52 -0500] "POST /notifications HTTP/1.1" 500 619 "-" "Amazon Simple Notification Service Agent" 72.21.217.180 - - [02/Mar/2017:15:33:52 -0500] "POST /notifications HTTP/1.1" 500 619 "-" "Amazon Simple Notification Service Agent" 72.21.217.75 - - [02/Mar/2017:15:33:52 -0500] "POST /notifications HTTP/1.1" 500 619 "-" "Amazon Simple Notification Service Agent" 72.21.217.80 - - [02/Mar/2017:15:33:52 -0500] "POST /notifications HTTP/1.1" 500 619 "-" "Amazon Simple Notification Service Agent" 72.21.217.74 - - [02/Mar/2017:15:33:52 -0500] "POST /notifications HTTP/1.1" 500 6404 "-" "Amazon Simple Notification Service Agent" 72.21.217.137 - - [02/Mar/2017:15:33:52 -0500] "POST /notifications HTTP/1.1" 500 619 "-" "Amazon Simple Notification Service Agent" 72.21.217.155 - - [02/Mar/2017:15:33:52 -0500] "POST /notifications HTTP/1.1" 500 619 "-" "Amazon Simple Notification Service Agent" 72.21.217.87 - - [02/Mar/2017:15:33:52 -0500] "POST /notifications HTTP/1.1" 500 619 "-" "Amazon Simple Notification Service Agent" 72.21.217.152 - - [02/Mar/2017:15:33:52 -0500] "POST /notifications HTTP/1.1" 500 619 "-" "Amazon Simple Notification Service Agent" 72.21.217.130 - - [02/Mar/2017:15:33:52 -0500] "POST /notifications HTTP/1.1" 500 619 "-" "Amazon Simple Notification Service Agent" 72.21.217.161 - - [02/Mar/2017:15:33:52 -0500] "POST /notifications HTTP/1.1" 500 619 "-" "Amazon Simple Notification Service Agent" 72.21.217.74 - - [02/Mar/2017:15:33:52 -0500] "POST /notifications HTTP/1.1" 500 619 "-" "Amazon Simple Notification Service Agent"

[更新]

仔细观察日志后，我发现我的应用程序正在响应500 。 起初我以为是Apache2，因为它收到了很多请求。 我猜SNS在没有收到成功信息的情况下会继续重新发送邮件（无限期地？）。

[更新2]

我能够得到正在发送的通知，并且对于被删除的文件是“ObjectRemoved：Delete”。 该文件不再存在于存储桶中。

我通过@EEAAbuild议的电子邮件订阅了不到15秒的时间，并且收到了252封电子邮件并计数：[对于相同的通知。

[更新3]

检查SNS主题上的传送策略，并确认重试设置为3！

在这里输入图像说明

注意：截至目前，我已收到来自S3的近900条通知。 我也注意到， x-amz-request-id和x-amz-id-2总是不同的，这是否意味着什么？

几点：

  1. 这些IP都分配给亚马逊，所以我们知道stream量来自亚马逊的networking。
  2. 您的服务器正在响应500错误代码。 这是故意的吗？
  3. 您应该可以执行数据包捕获来查看POST数据。
  4. 如果您无法执行数据包捕获，您也可以通过电子邮件订阅SNS主题很短的时间，SNS消息的详细信息将发送到您的电子邮件。