Skip to content

Add sysmon-handler to RabbitMQ #1816

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 1 commit into from
Jan 9, 2019
Merged

Add sysmon-handler to RabbitMQ #1816

merged 1 commit into from
Jan 9, 2019

Conversation

lukebakken
Copy link
Collaborator

@lukebakken lukebakken commented Jan 3, 2019 •
edited
Loading

Fixes #952

I'm investigating how to trigger some of the monitored events, like busy_dist_port, for QA purposes.

@lukebakken lukebakken force-pushed the rabbitmq-server-952 branch 3 times, most recently from 1128b6b to a67f30f Compare January 3, 2019 20:17
@lukebakken lukebakken changed the title WIP: Add rabbitmq-sysmon to RabbitMQ Add rabbitmq-sysmon to RabbitMQ Jan 3, 2019
@lukebakken lukebakken changed the title Add rabbitmq-sysmon to RabbitMQ WIP: Add rabbitmq-sysmon to RabbitMQ Jan 4, 2019
@lukebakken lukebakken removed the request for review from michaelklishin January 4, 2019 15:39
@lukebakken lukebakken changed the title WIP: Add rabbitmq-sysmon to RabbitMQ WIP: Add sysmon-handler to RabbitMQ Jan 4, 2019
@lukebakken lukebakken force-pushed the rabbitmq-server-952 branch from 1edc89d to 9f3ace8 Compare January 4, 2019 21:10
@lukebakken lukebakken changed the title WIP: Add sysmon-handler to RabbitMQ Add sysmon-handler to RabbitMQ Jan 7, 2019
@lukebakken
Copy link
Collaborator Author

lukebakken commented Jan 7, 2019 •
edited
Loading

Testing instructions:

  • Use the following rabbitmq.conf file:
sysmon_handler.thresholds.busy_processes = 15
sysmon_handler.thresholds.busy_ports = 1
sysmon_handler.triggers.process.garbage_collection = 1ms
sysmon_handler.triggers.process.long_scheduled_execution = 1ms
sysmon_handler.triggers.process.heap_size = 1KB
sysmon_handler.triggers.port = on
sysmon_handler.triggers.distribution_port = on

  • Start up a two node-cluster using the above config and RABBITMQ_SERVER_ADDITIONAL_ERL_ARGS='+zdbbl 1'. Add a policy to mirror all queues to all nodes.

  • Start up PerfTest using a large file as the message body:

--rate 5 --exclusive --producers 1 --consumers 1 --body /home/lbakken/issues/misc/random-64MiB.txt

You should see busy_dist_port, large_heap and maybe other messages as warning lines in the log file.

@lukebakken
Add rabbitmq-sysmon to RabbitMQ
2b934f3 
Fixes #952

Update for rabbitmq-sysmon -> sysmon-handler rename

Use hex.pm package for sysmon_handler, copy schema into rabbit.schema
@lukebakken lukebakken force-pushed the rabbitmq-server-952 branch from d3eed6a to 2b934f3 Compare January 7, 2019 20:58
@michaelklishin michaelklishin merged commit be27684 into master Jan 9, 2019
@michaelklishin michaelklishin deleted the rabbitmq-server-952 branch January 9, 2019 00:46
lukebakken pushed a commit that referenced this pull request Jan 10, 2019
@michaelklishin @lukebakken
Merge pull request #1816 from rabbitmq/rabbitmq-server-952
3ee48be 
Add sysmon-handler to RabbitMQ

(cherry picked from commit be27684)
lukebakken pushed a commit that referenced this pull request Jan 10, 2019
@michaelklishin @lukebakken
Merge pull request #1816 from rabbitmq/rabbitmq-server-952
1475256 
Add sysmon-handler to RabbitMQ

(cherry picked from commit be27684)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@michaelklishin michaelklishin michaelklishin approved these changes

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@lukebakken @michaelklishin