Commit Graph

237 Commits

Author SHA1 Message Date
Alexey Lavrenuke
104d56e9b8 WIP,aggregates, hangs on exit 2015-11-25 21:21:19 +03:00
Alexey Lavrenuke
155f447736 start removing old aggregator. Add Close() method to AbstractPlugin 2015-11-25 16:03:27 +03:00
Alexey Lavrenuke
a168247db1 phantom reader 2015-11-24 21:16:58 +03:00
Alexey Lavrenuke
9ae44b8b41 aggregator and tests 2015-11-24 19:54:53 +03:00
Alexey Lavrenuke
16ca043721 Merge branch 'master' of github.com:yandex/yandex-tank into new-aggregator 2015-11-24 14:47:27 +03:00
Alexey Lavrenuke
fc27b3f8e1 catch ALL exceptions when trying to execute ssh command 2015-11-24 14:46:32 +03:00
Alexey Lavrenuke
4948cf523c consider ssh timeout parameter 2015-11-24 14:39:20 +03:00
Alexey Lavrenuke
3669d68cfd start work on chopper 2015-11-24 14:35:41 +03:00
Alexey Lavrenuke
73f018db08 Merge branch 'master' of github.com:yandex/yandex-tank into new-aggregator 2015-11-23 20:30:06 +03:00
Alexey Lavrenuke
0adabe56a2 logging 2015-11-19 19:52:49 +03:00
Alexey Lavrenuke
b3f8fc44e4 return when failed to install monitoring 2015-11-19 17:59:07 +03:00
Alexey Lavrenuke
20a7700455 catch authentication exception 2015-11-19 17:57:48 +03:00
Alexey Lavrenuke
2e4fa3ab01 less verbose logging 2015-11-18 17:53:18 +03:00
Alexey Lavrenuke
86d3cf7e41 fix bug 2015-11-18 17:06:52 +03:00
Alexey Lavrenuke
e7c8c81cfc monitoring agent data bufferization 2015-11-18 15:31:46 +03:00
Alexey Lavrenuke
3425a54859 monitoring poll 2015-11-17 19:34:42 +03:00
Alexey Lavrenuke
f7c5a2a11f better logging 2015-11-17 19:27:43 +03:00
Alexey Lavrenuke
2575099ada log message formatting 2015-11-17 19:17:38 +03:00
Alexey Lavrenuke
837a5c301f some details 2015-11-17 19:16:06 +03:00
Alexey Lavrenuke
8d9ecbb90d less verbose logging 2015-11-17 19:13:04 +03:00
Alexey Lavrenuke
846924cc97 pep8 2015-11-17 19:07:01 +03:00
Alexey Lavrenuke
4e8886c70b no exceptions 2015-11-17 17:52:25 +03:00
Alexey Lavrenuke
6cd75fcb63 migrate monitoring to paramiko 2015-11-17 17:01:49 +03:00
Alexey Lavrenuke
08c1806bac trying paramiko 2015-11-16 19:30:08 +03:00
Alexey Lavrenuke
43ec893d68 close phantom log 2015-11-13 21:49:46 +03:00
Alexey Lavrenuke
64eb70baf4 close mon file on end_test 2015-11-13 21:35:35 +03:00
Alexey Lavrenuke
65fb3d7496 catch exceptions on removing agent 2015-11-13 21:06:06 +03:00
Alexey Lavrenuke
a1041b02ea pep8 2015-11-13 20:01:35 +03:00
Alexey Lavrenuke
251b1e0567 close pipes after stop 2015-11-13 18:13:35 +03:00
Alexey Lavrenuke
b6228313ca close mon file in finalizer 2015-11-13 17:03:16 +03:00
Alexey Lavrenuke
e3e6f9814a start implementing new aggregator 2015-11-12 18:17:49 +03:00
Alexey Lavrenuke
5d816d81ab grafana link 2015-11-09 20:20:00 +03:00
Alexey Lavrenuke
2b5dada3f8 unique id 2015-11-09 19:14:35 +03:00
Alexey Lavrenuke
c8dade33c3 parameters in influxdb plugin 2015-11-09 18:35:18 +03:00
Alexey Lavrenuke
c65a88bbda tank tag 2015-11-08 00:34:31 +03:00
Alexey Lavrenuke
0cc2e8c014 InfluxDB plugin 2015-11-07 20:21:02 +03:00
Alexey Lavrenuke
0d84d9839a support pandora gun types 2015-10-30 19:50:05 +03:00
Alexey Lavrenuke
d9dae1f18e stepper info was immutable 2015-10-29 16:51:57 +03:00
Alexey Lavrenuke
7cb822bb12 appears that #71 is harder then it seemed 2015-10-29 16:45:12 +03:00
Alexey Lavrenuke
1259321d5f propose a fix for #71 2015-10-29 16:20:10 +03:00
Alexey Lavrenuke
d5e9907a3e * change default artifacts dir to ./logs
* require psutil >= 1.2.1
2015-10-29 15:56:02 +03:00
Alexey Lavrenuke
78a234a14a float insead of int 2015-10-28 18:21:21 +03:00
Alexey Lavrenuke
c874636469 auto-convert old-style plugin paths 2015-10-28 16:16:13 +03:00
Alexey Lavrenuke
b51e38e7c8 * pandora plugin docs
* add ifmain to cli.py
2015-10-27 16:34:03 +03:00
Alexey Lavrenuke
4d227109c3 set pandora target from load.ini 2015-10-27 15:33:43 +03:00
Alexey Lavrenuke
3f106404b2 pandora schedule in config 2015-10-26 19:27:39 +03:00
Alexey Lavrenuke
dcc68ee333 Pandora support 2015-10-26 18:52:35 +03:00
Epikhin Mikhail
47d8e23554 Use one taskset_path. Use 'affinity' instead of 'cpu' 2015-09-24 16:51:10 +03:00
Epikhin Mikhail
39d5754922 Added taskset for tankcore 2015-09-23 21:36:00 +03:00
Epikhin Mikhail
796e2c5b2b Added taskset for phantom 2015-09-23 20:42:40 +03:00
Alexey Lavrenuke
673b4b3110 override headers anywhere in uri-style and uri+post-style ammo files 2015-09-11 19:09:17 +03:00
Alexey Lavrenuke
34e882afa6 retry posting killer tasks if queue full 2015-09-11 16:58:43 +03:00
Alexey Lavrenuke
d1dd93269d Merge pull request #174 from nnugumanov/phantom-ssl-configure
added support in yandex-tank for client certificates and client cipher lists
2015-08-25 14:42:13 +03:00
Nurlan Nugumanov
6aa6392a5e added support in yandex-tank for client certificates and client cipher lists
new options:
client_cipher_suites - preferred client's ciphers list
client_certificate, client_key - certificate and it's private key used in Client-auth TLS handshake
2015-08-25 00:49:16 +06:00
Tonsofattraction
d009bcdd1b We still need to decode content for ungzipped data
But we have to read more from stream so that we can be sure to receive those 2 bytes we need
2015-08-24 17:22:52 +03:00
Alexey Lavrenuke
58e879c367 Merge pull request #170 from nnugumanov/HEAD_with_content-length
requests.head omits Content-Length
2015-08-24 16:37:42 +03:00
Alexey Lavrenuke
f4798c9e98 Merge pull request #166 from maklaut/master
Extend JMeter known exceptions + fix for #106
2015-08-24 16:28:55 +03:00
Alexey Lavrenuke
b489154d25 Merge pull request #172 from Tonsofattraction/patch-2
download ammofiles of unknown content-length
2015-08-24 16:27:46 +03:00
Tonsofattraction
098971ba4c download ammofiles of unknown content-length 2015-08-24 15:27:40 +03:00
Tonsofattraction
94fa7b58e4 correct gzip detection
do not decode stream content for binary comparison
2015-08-24 15:12:02 +03:00
Nurlan Nugumanov
c32fe54786 requests.head omits Content-Length and therefore yandex-tank cannot determine the ammofile size and always streams it
https://github.com/kennethreitz/requests/issues/2731
Requests library specifies gzip, deflate as acceptable encodings by default and urllib2 specifies identity by default.
2015-08-20 16:20:47 +03:00
Alexey Lavrenuke
37363823bd Merge pull request #167 from asekretenko/master
Autostop plugin: save criteria string that triggered autostop;  shellexec.catch_out option
2015-07-28 16:40:32 +03:00
Alexander Sukhov
14a0bf0e73 Fix for issue #106 jmeter custom log cause an empty stats in yandex-tank 2015-07-24 19:57:36 +03:00
Alexander Sukhov
a12bfa92ad Extend JMeter known exceptions 2015-07-24 19:55:56 +03:00
Alexey Lavrenuke
53660d859c Merge pull request #165 from nnugumanov/master
bugfix for previous pull 163
2015-07-22 17:44:08 +03:00
Alexey Lavrenuke
65b9a3ebb9 Merge pull request #164 from netortik/master
Monitoring plugin metrics CpuLa and CpuStat refactoring
2015-07-22 17:43:13 +03:00
Nurlan Nugumanov
883713b3d1 if there are no access to targets or monitoring.config=none, then MonitoringPlugin.MonitoringCollector() doesn't exist 2015-07-22 17:32:52 +03:00
netortik
98d4cda848 removed 'with'-construction in order to support python <2.7 2015-07-22 17:20:13 +03:00
netortik
23a740023d Monitoring plugin metrics CpuLa and CpuStat refactoring 2015-07-22 15:52:49 +03:00
Nurlan Nugumanov
b60befab86 Fixed bug with excessive amount of send_data collected from agents
agent starts collecting date in prepare_test() stage. If for some reasons, start_test() has been delayed, agent's pipe collects unnecessary data.
And when start_test() occures, MonitoringCollector.poll prints huge blocks, thanks to debug print "Data after filtering .."

Fix: there is nothing to be done with agent - it doesn't know test status, when it was started etc.
So the only option is to compare timestamps from agent's data with time when start_test() has been occured and therefore
1) reduce debug output
2) send to datastorage only needed data
2015-07-22 13:45:51 +03:00
Andrey Sekretenko
8f3df93d37 shellexec.catch_out option 2015-07-16 15:42:18 +03:00
Andrey Sekretenko
453d473d34 Merge branch 'master' of github.com:yandex/yandex-tank 2015-07-16 12:04:07 +03:00
Tonsofattraction
0d4f3edad5 Update util.py
handle 405 for head method
handle 302 for head method
2015-06-29 19:51:12 +03:00
Alexey Lavrenuke
5eec183198 publish eta 2015-06-23 15:17:48 +03:00
Alexey Lavrenuke
22cf2b3484 indent status json 2015-06-23 14:04:09 +03:00
Alexey Lavrenuke
ef72b3646e log status 2015-06-23 14:02:06 +03:00
Alexey Lavrenuke
bc47282df0 pep8, logging 2015-06-23 12:50:00 +03:00
Alexey Lavrenuke
f02de45f2d add status publisher to tankcore 2015-06-23 12:29:13 +03:00
Alexey Lavrenuke
6d87a9ed54 more logging 2015-06-17 19:29:49 +03:00
Alexey Lavrenuke
ab0f1e2d33 Merge branch 'master' of github.com:yandex/yandex-tank 2015-06-17 18:17:39 +03:00
Alexey Lavrenuke
2af6d2ba11 catch exceptions from scenarios 2015-06-17 18:15:51 +03:00
Alexey Lavrenuke
4a5cc9b885 Merge pull request #157 from Tonsofattraction/http_opener
Http opener
2015-06-15 18:30:17 +03:00
Tonsofattraction
3055a9099a syntax fix 2015-06-15 16:52:04 +03:00
Tonsofattraction
c18bdaa6fa indent fix
github editor indentations definitely need to be fixed
2015-06-15 16:50:05 +03:00
Tonsofattraction
71629a7936 stupid indents... 2015-06-15 16:35:57 +03:00
Tonsofattraction
f276aeeff8 indent fix 2015-06-15 16:13:06 +03:00
Tonsofattraction
8dffe9d9aa indent fix 2015-06-15 16:07:36 +03:00
Tonsofattraction
91cbd188d4 Update main.py
use opener's hash property for stpd file hash
2015-06-15 15:53:48 +03:00
Tonsofattraction
f6a1af64f0 Update missile.py
make missiles use openers as objects
2015-06-15 15:49:59 +03:00
Tonsofattraction
95507634d4 Update util.py
fs_opener and gz_opener as well as http_opener have hash and data_length properties 
python-requests dependency used here
2015-06-15 15:44:56 +03:00
Alexey Lavrenuke
c99b4c8524 scenario gun 2015-06-15 15:17:09 +03:00
Alexey Lavrenuke
37dc212fcc rework it in the morning 8) 2015-06-12 08:25:37 +03:00
Alexey Lavrenuke
7b05fd3893 silly while() bug 2015-06-11 19:54:00 +03:00
Alexey Lavrenuke
a213e026cd sometimes hangs after Ctrl-C on queue 2015-06-11 19:49:25 +03:00
Alexey Lavrenuke
b7c12d0edb add timeout to feeder put 2015-06-11 17:38:47 +03:00
Alexey Lavrenuke
231ce4b69e killer tasks 2015-06-11 13:22:09 +03:00
Alexey Lavrenuke
bfc295cec7 some bugs in bfg 2015-06-10 19:02:14 +03:00
Andrey Sekretenko
66a850a2ab Autostop plugin: save criteria string triggered autostop; code cleanup 2015-05-09 18:02:36 +03:00
Alexey Lavrenuke
b40ed8b1dc Merge pull request #151 from epikhinm/exclude_markers
Add "exclude_markers" feature to Phantom and JMeter
2015-04-20 14:04:42 +03:00
Epikhin Mikhail
f551baaa37 Add feature exclude_markers for Phantom and JMeter 2015-04-20 00:02:00 +03:00
Epikhin Mikhail
d5da3dad8c Add some exceptions for resolving net_codes in JMeter plugin 2015-04-19 22:11:33 +03:00
Alexey Lavrenuke
d405abd44d plugins is a list of plugin classes now 2015-03-17 15:20:15 +03:00
Alexey Lavrenuke
f48c487ac0 log exceptions in pythonic way 2015-03-17 15:17:10 +03:00
Alexey Lavrenuke
d0f8f4264b logging bugs in agent 2015-03-17 15:09:23 +03:00
Alexey Lavrenuke
51789c6110 bug in console plugin 2015-03-17 15:02:26 +03:00
Alexey Lavrenuke
afed810f97 change logger in mon agent 2015-03-17 14:58:36 +03:00
Alexey Lavrenuke
1e0ca516ff change logger in monitoring plugin 2015-03-17 14:56:38 +03:00
Alexey Lavrenuke
930bde237b fix 'no agregator plugin' messages in JMeterPlugin test 2015-02-17 11:58:12 +03:00
Andrew Grigorev
5947b910ad Fix monitoring config
Allow monitoring config to contain XML body as well as file name.

Added test.
2015-02-17 02:16:13 +03:00
Andrew Grigorev
a4537eb8fd fix get_host_config args, add test 2015-02-16 14:10:11 +03:00
Andrew Grigorev
0b519dc339 Fix Monitoring.collector
The xml.etree.ElementTree.find/findall method don't need the root element in path.
2015-02-14 19:30:43 +03:00
Andrew Grigorev
f05abad29d Fix __check_mem
New versions of "free" command don't output the "-/+ buffers/cache" line. Also
yandextank already depends on an exellent psutil library, why shouldn't it be
used to get available memory volume?
2015-02-14 02:18:54 +03:00
Alexey Lavrenuke
d75c61811e Merge pull request #134 from ei-grad/issue126
More intuitive error message when phantom is missing, fix #126
2015-02-13 02:35:33 +03:00
Andrew Grigorev
4844b1b62e More intuitive error message when phantom is missing, fix #126 2015-02-13 00:38:15 +03:00
Andrew Grigorev
dc902a82a2 plugins.Monitoring.collector pythonization 2015-02-13 00:10:22 +03:00
Andrew Grigorev
e80da71693 Replace lxml with xml from standard lib, fix #132
The lxml library is used there only for config file parsing, it is real overhead
to install optimized C library for that.
2015-02-12 23:11:25 +03:00
Alexey Lavrenuke
45d45f6f8c fix it! 2015-02-11 18:09:16 +03:00
Alexey Lavrenuke
9fa302ff4c fix build 2015-02-11 17:52:34 +03:00
Alexey Lavrenuke
cd68f80006 add params to cache hash, change version 2015-02-11 17:40:25 +03:00
Alexey Lavrenuke
47431ddd93 Add enum_ammo parameter 2015-02-11 17:19:44 +03:00
Alexey Lavrenuke
8d568bd35d enumerator in marker module 2015-02-11 16:55:45 +03:00
Alexey Lavrenuke
ba649ae255 typo 2015-02-09 19:04:19 +03:00
Alexey Lavrenuke
4cd7e1ee7d typo 2015-02-09 18:36:11 +03:00
Alexey Lavrenuke
87466efb97 move default tank config into package 2015-02-09 18:26:14 +03:00
Alexey Lavrenuke
a3ad499c34 move plugins config files to into python modules and use pkg_resources 2015-02-06 16:35:16 +03:00
Alexey Lavrenuke
5ce87acb0f config is in subfolder 2015-02-05 15:13:46 +03:00
Alexey Lavrenuke
d4e94396ce from now on OnlineReport is an external plugin 2015-02-05 15:05:39 +03:00
Alexey Lavrenuke
d5ac78b2d7 typos 2015-02-05 15:00:46 +03:00
Alexey Lavrenuke
0d4b53d21b * add ez_setup
* move all configs to /etc/yandextank
2015-02-05 14:46:45 +03:00
Alexey Lavrenuke
d0b17123ab move monitoring config to etc 2015-02-04 21:23:33 +03:00
Alexey Lavrenuke
e1ce7b834a update imports in BFG 2015-02-04 21:16:33 +03:00
Alexey Lavrenuke
2660478dd2 migrate to new plugin import code 2015-02-04 20:42:56 +03:00
Alexey Lavrenuke
e55d1dfc27 cosmetics 2015-02-04 19:52:49 +03:00
Alexey Lavrenuke
24113fa002 find packages automatically 2015-02-04 17:55:33 +03:00
Alexey Lavrenuke
b5552d05fc entry point 2015-02-04 15:57:12 +03:00
Alexey Lavrenuke
a22aea7ab2 Monitoring plugin to separate directory 2015-02-04 15:01:36 +03:00
Alexey Lavrenuke
dca844bf68 Moving files around 2015-02-03 12:35:48 +03:00