如何解决aws aurora mysql 集群实例内存泄漏或在几天内耗尽
我使用的是 aws aurora mysql 集群版本 5.7.mysql_aurora.2.04.2，实例大小 r5.xlarge（32GB 内存） 我遇到的问题是，几天后主实例内存开始耗尽，可用内存下降到故障转移集群或重启实例的程度。
这是我的参数组参数： 到目前为止，我已将 innodb_buffer_pool_size 保留为默认值，即总内存的 75% 查询缓存大小 = 0 查询缓存类型 = 0 我还没有研究任何其他参数，只是将它们保留为默认设置
在高峰时间大约有。 400-500 个连接，但活动连接只有 4-5 个。我确实检查了性能模式内存统计数据，发现这里的连接并没有真正消耗太多内存。
这是我最近的服务器状态
=====================================
2021-06-02 00:21:02 0x2ac656ac3700 INNODB MONITOR OUTPUT
=====================================
Per second averages calculated from the last 49 seconds
-----------------
BACKGROUND THREAD
-----------------
srv_master_thread loops: 64605 srv_active,0 srv_shutdown,39 srv_idle
srv_master_thread log flush and writes: 0
----------
SEMAPHORES
----------
OS WAIT ARRAY INFO: reservation count 482279
OS WAIT ARRAY INFO: signal count 456598
RW-shared spins 0,rounds 602358,OS waits 242442
RW-excl spins 0,rounds 481661,OS waits 9408
RW-sx spins 59854,rounds 1519404,OS waits 38433
Spin rounds per wait: 602358.00 RW-shared,481661.00 RW-excl,25.39 RW-sx
------------
TRANSACTIONS
------------
Trx id counter 20693553688
Purge done for trx's n:o < 20693552345 undo n:o < 0 state: running but idle
History list length 2519
--------
FILE I/O
--------
I/O thread 0 state: waiting for i/o request (insert buffer thread)
I/O thread 1 state: waiting for i/o request (log thread)
I/O thread 2 state: waiting for i/o request (read thread)
I/O thread 3 state: waiting for i/o request (read thread)
I/O thread 4 state: waiting for i/o request (read thread)
I/O thread 5 state: waiting for i/o request (read thread)
I/O thread 6 state: waiting for i/o request (write thread)
I/O thread 7 state: waiting for i/o request (write thread)
I/O thread 8 state: waiting for i/o request (write thread)
I/O thread 9 state: waiting for i/o request (write thread)
Pending normal aio reads: [0,0],aio writes: [0,ibuf aio reads:,log i/o's:,sync i/o's:
Pending flushes (fsync) log: 0; buffer pool: 0
0 OS file reads,0 OS file writes,0 OS fsyncs
0.00 reads/s,0 avg bytes/read,0.00 writes/s,0.00 fsyncs/s
-------------------------------------
INSERT BUFFER AND ADAPTIVE HASH INDEX
-------------------------------------
Ibuf: size 1,free list len 0,seg size 2,0 merges
merged operations:
insert 0,delete mark 0,delete 0
discarded operations:
insert 0,delete 0
Hash table size 5174291,node heap has 0 buffer(s)
Hash table size 5174291,node heap has 0 buffer(s)
0.00 hash searches/s,9043.71 non-hash searches/s
---
LOG
---
Log sequence number 8204
Log flushed up to 0
Pages flushed up to 8204
Last checkpoint at 8192
0 pending log flushes,0 pending chkp writes
0 log i/o's done,0.00 log i/o's/second
----------------------
BUFFER POOL AND MEMORY
----------------------
Total large memory allocated 0
Dictionary memory allocated 281737
Buffer pool size 1276548
Free buffers 61908
Database pages 1214640
Old database pages 448316
Modified db pages 20
Pending reads 0
Pending writes: LRU 0,flush list 0,single page 0
Pages made young 1544709,not young 4583067
32.45 youngs/s,84.47 non-youngs/s
Pages read 966252,created 1919667,written 194
18.90 reads/s,98.47 creates/s,0.00 writes/s
Buffer pool hit rate 1000 / 1000,young-making rate 0 / 1000 not 1 / 1000
Pages read ahead 0.00/s,evicted without access 0.00/s,Random read ahead 0.00/s
LRU len: 1214640,unzip_LRU len: 0
I/O sum[3080]:cur[0],unzip sum[0]:cur[0]
----------------------
INDIVIDUAL BUFFER POOL INFO
----------------------
---BUFFER POOL 0
Buffer pool size 319137
Free buffers 12682
Database pages 306455
Old database pages 113129
Modified db pages 0
Pending reads 0
Pending writes: LRU 0,single page 0
Pages made young 389940,not young 1141638
8.41 youngs/s,17.20 non-youngs/s
Pages read 242260,created 482146,written 0
5.29 reads/s,20.26 creates/s,Random read ahead 0.00/s
LRU len: 306455,unzip_LRU len: 0
I/O sum[770]:cur[0],unzip sum[0]:cur[0]
---BUFFER POOL 1
Buffer pool size 319137
Free buffers 17337
Database pages 301800
Old database pages 111386
Modified db pages 0
Pending reads 0
Pending writes: LRU 0,single page 0
Pages made young 381508,not young 1142265
7.69 youngs/s,26.55 non-youngs/s
Pages read 241892,created 480398,written 0
4.55 reads/s,27.35 creates/s,young-making rate 0 / 1000 not 2 / 1000
Pages read ahead 0.00/s,Random read ahead 0.00/s
LRU len: 301800,unzip sum[0]:cur[0]
---BUFFER POOL 2
Buffer pool size 319137
Free buffers 14628
Database pages 304509
Old database pages 112387
Modified db pages 0
Pending reads 0
Pending writes: LRU 0,single page 0
Pages made young 389540,not young 1154116
7.88 youngs/s,25.08 non-youngs/s
Pages read 242468,created 480735,written 0
4.69 reads/s,26.55 creates/s,Random read ahead 0.00/s
LRU len: 304509,unzip sum[0]:cur[0]
---BUFFER POOL 3
Buffer pool size 319137
Free buffers 17261
Database pages 301876
Old database pages 111414
Modified db pages 20
Pending reads 0
Pending writes: LRU 0,single page 0
Pages made young 383721,not young 1145048
8.47 youngs/s,15.63 non-youngs/s
Pages read 239632,created 476388,written 194
4.37 reads/s,24.31 creates/s,young-making rate 0 / 1000 not 0 / 1000
Pages read ahead 0.00/s,Random read ahead 0.00/s
LRU len: 301876,unzip sum[0]:cur[0]
--------------
ROW OPERATIONS
--------------
0 queries inside InnoDB,0 queries in queue
0 read views open inside InnoDB
Process ID=16917,Main thread ID=47055544436480,state: sleeping
Number of rows inserted 4663043,updated 3954657,deleted 4438202,read 15553254
407.46 inserts/s,247.73 updates/s,283.69 deletes/s,918.53 reads/s
----------------------------
END OF INNODB MONITOR OUTPUT
============================
请查找最近 3 天的内存/连接数/cpu 利用率
解决方法
在 aurora mysql 实例中将缓冲池调整为总内存的 50% 后，我可以在可用内存中创建更多空间，这无疑减少了由于内存消耗过多而导致的故障转移。
然而，某些百分比的内存耗尽仍在发生，当您在数据库中打开如此多的连接时，这可能是预期的行为
我们还尝试利用 RDS 代理将连接池连接到 RDS 集群，这可能有助于更好地管理连接并进一步减少内存消耗。
版权声明：本文内容由互联网用户自发贡献，该文观点与技术仅代表作者本人。本站仅提供信息存储空间服务，不拥有所有权，不承担相关法律责任。如发现本站有涉嫌侵权/违法违规的内容， 请发送邮件至 dio@foxmail.com 举报，一经查实，本站将立刻删除。