-
Notifications
You must be signed in to change notification settings - Fork 32
/
README
149 lines (99 loc) · 4.4 KB
/
README
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
An extremely rough but extremely damaging benchmark utility for memcached.
Does not use a client library.
Building
--------
$ (install libevent + headers)
$ ./compile
Usage
-----
Look in the conf/ directory for example configuration files.
$ ./mc-crusher --conf ./conf/loadconf --ip [ip] --port [port]
defaults:
host: 127.0.0.1
port: 11211
Running
-------
You can use the included bench-warmer.pl tool to preload some keys. mc-crusher
makes no attempt to recache anything on a miss.
Pick a config file, and start it as above. You should start a fresh memcached,
and run the "sample" script that comes with mc-crusher. mc-crusher makes no
attempt to read or validate response data.
Modify "sample" to print what you are most interested in examining.
The latency-sampler utility included is used to measure response latency
during a test. You must run it yourself, either after a warmup period or at
the same time as a test.
Start options
-------------
--conf [file]
- the test configuration to load/run.
--ip [127.0.0.1]
- IP address to connect to.
--port [11211]
- port to connect to.
--timeout [seconds]
- stop the test after this amount of time
--zipf-n
--zipf-s
- Commands which will dump a curve from the supplied zipf arguments (N being
limit, S being curve skew (0.00-2.00 useful range).
- Exits after dumping 10 million key:frequency ratios.
- Used for tuning zipf arguments in a config file. High skew gives "hot
keys". Low skew gives a more gentle curve.
Configuration
-------------
mc-crusher reads a configuration file then begins a test run. These configurations
describe a template of a connection, one per line.
Each template can spawn N connections. This allows you to mix setters and
getters, getters of different sizes, binprot + asciiprot.
Config Options
--------------
send : defines what function to use to send requests to memcached
- ascii_get : one get per request via asciiprot
- ascii_set : one set per request via asciiprot
- ascii_delete : one delete per request via asciiprot
- ascii_mget : multiget test via asciiprot
- bin_get : one get per req via binprot
- bin_getq : endless streaming multiget from hell
- bin_set : one set per req via binprot
- bin_setq : unleash cthulu upon the cache_lock
recv : same, but for received data
- blind_recv : mindlessly slurp any responses without inspecting them
mget_count : set this to the number of keys to fetch per get in ascii_mget
key_prefix : a string to prefix before each key's number (default 'foo')
value_size : size of the value to set
expire : the expiration value (default 0)
flags : client flags (raw number, default 0)
value : define a value by hand. Must be shortish and a string.
host : define a host to connect to
port : define a port to connect to
key_count : number of keys to iterate across. use with key_prealloc=0 to
iterate over large numbers of keys
key_randomize : shuffle the keys rather than fetching in order
usleep : fire one write event (up to pipeline count) with a microsecond sleep
after. the sleep is per-connection (so conns=2 will write twice per usleep)
stop_after : stop all conns for this test after N writes have been made.
pipelines : stack this many requests into the same syscall. Useful for
reducing some overhead for high request rates.
thread : number of threads to spawn with the same configuration. This means if
conns=1,thread=4 there will be four total connections made.
live_rand : if set to 1, will use embedded PCG randomizer to choose keys.
(default 0)
live_rand_zipf : if set to 1, paired with zipf_skew, will choose a key
randomizer which skews according to a zipf distribution (ie; keys early in the
list have a higher use bias).
zipf_skew : typically 0.01 to 2.00 in range. Higher skews create hot-key
scenarios, where a bulk of accesses are a handful of keys. Lower skews are
useful for creating somewhat realistic workloads of hot vs not as hot keys.
Caveats
-------
- Does not make any attempt to safely parse or validate the config file.
- It only works well with small values
- It makes no attempt to reconcile with errors in the protocol, and can break
if memcached throws errors. It will also stop if the connections are closed.
- It's a ton of fun!
Future Features
---------------
A short list of things I intend to change or add:
- Fix the command generators to have a *little* error handling
- Add commands to iterate over different value sizes
- Bundle a better perl util for printing stats