Commit Graph

75 Commits

Author SHA1 Message Date
Lucas Manuel Rodriguez
4acb713bf1
osquery-perf changes for Fleet downtime load test (#17310)
Including all the osquery-perf changes needed to perform #16423.
2024-03-04 15:10:10 -03:00
Gabriel Hernandez
6442716fb9
go 1.21.7 upgrade (#16980)
relates to #16794

upgrade golang to 1.21.7


- [x] Changes file added for user-visible changes in `changes/` or
`orbit/changes/`.
See [Changes
files](https://fleetdm.com/docs/contributing/committing-changes#changes-files)
for more information.
- [x] Manual QA for all new/changed functionality
2024-02-22 15:02:41 +00:00
Lucas Manuel Rodriguez
b911b36fb0
Amend loadtesting readme (#16981)
#16423.

Instructions were wrong, this is the way.
2024-02-20 11:18:22 -03:00
Lucas Manuel Rodriguez
9080ff5361
Add docs on how to rebuild osquery-perf for load testing (#16970)
I had to run these steps for #16423. (To reduce memory footprint of
osquery-perf.)
2024-02-19 19:27:24 -03:00
Robert Fairburn
3eddd82e3e
Fix mysql 8.0 compatibility in loadtesting. (#16964)
Old snapshot was 5.7 would no longer work
2024-02-19 14:16:31 -06:00
Roberto Dip
4aff553f1b
update Go to 1.21.6 (#16405)
for https://github.com/fleetdm/fleet/issues/16278
2024-01-29 15:11:07 -03:00
Robert Fairburn
ef842e5c4f
Update loadtesting RDS module to allow for a db parameter gorup (#15882) 2024-01-08 11:18:32 -06:00
Roberto Dip
6353849004
update Go to 1.21.5 (#15592)
for https://github.com/fleetdm/fleet/issues/15584

# Checklist for submitter

If some of the following don't apply, delete the relevant line.

<!-- Note that API documentation changes are now addressed by the
product design team. -->

- [x] Changes file added for user-visible changes in `changes/` or
`orbit/changes/`.
See [Changes
files](https://fleetdm.com/docs/contributing/committing-changes#changes-files)
for more information.
- [x] Manual QA for all new/changed functionality
2023-12-13 13:57:12 -03:00
Roberto Dip
e24070b33a
adjust the loadtesting docs (#15526)
minor changes after running a loadtest
2023-12-08 16:15:18 -03:00
Robert Fairburn
b31e45244d
Some loadtesting improvements to solve common issues (#15360) 2023-11-30 16:36:04 -06:00
Robert Fairburn
5a99186fe2
Some documentation updates (#15369) 2023-11-29 17:23:49 -06:00
Lucas Manuel Rodriguez
3122d93ce4
loadtesting: Redirect osquery results and status logs to /dev/null (#14848)
This is to avoid firehose (rate limit) errors when load testing query
reports with thousands of hosts. (And may reduce cost by storing logs
nowhere.)

Thanks @rfairburn:
https://github.com/fleetdm/fleet/pull/14754#issuecomment-1788887575
2023-11-01 12:11:21 -03:00
Robert Fairburn
dae94c3129
Fix ACL Errors (#14525) 2023-10-27 10:20:07 -05:00
Roberto Dip
ad9e30f120
Update Go to v1.21.3 (#14634)
for #14633
2023-10-19 10:01:05 -03:00
Lucas Manuel Rodriguez
910e26b93e
Amend loadtesting terraform docs (#14549) 2023-10-13 17:05:00 -03:00
Roberto Dip
e46e83baf8
upgrade Go to 1.21.1 for infra (#13878)
related to #13715, this updates the infra dependencies for the general
go upgrade that's happening at
https://github.com/fleetdm/fleet/pull/13877

I'm thinking we probably want to merge this after we're sure that
everything works well, maybe even after we have a release with go 1.21.1
out, so I'm making a separate PR.

---------

Co-authored-by: Martin Angers <martin.n.angers@gmail.com>
2023-10-12 21:09:17 -05:00
Luke Heath
191348208e
Update contact instructions (#14333) 2023-10-05 15:09:09 -05:00
Martin Angers
1ce9eb5976
Fix invalid digest used in loadtest dockerfile (#13916) 2023-09-13 16:02:33 -04:00
Roberto Dip
5ad734d617
upgrade go to v1.19.12 (#13617) 2023-08-31 13:49:24 -05:00
Lucas Manuel Rodriguez
22b879bcef
Add instructions to deploy server code changes to a loadtest env (#13563)
#12696
2023-08-29 11:06:32 -03:00
Roberto Dip
d9de78e9fc
upgrade Go version to 1.19.11 (#12902) 2023-07-26 11:09:22 -07:00
Lucas Manuel Rodriguez
b803bbe5bf
osquery-perf changes needed for load testing with simulated Windows hosts (#12754)
Changes in osquery-perf to allow for testing of Windows hosts in
loadtest environments.
2023-07-14 13:06:34 -03:00
Roberto Dip
ab9ac28538
upgrade go version to 1.19.10 (#12187)
for #12177
2023-06-07 17:59:30 -03:00
Luke Heath
1f8ca0bbb4
Use personal access token for workflows (#12118) 2023-06-02 16:23:23 -05:00
Lucas Manuel Rodriguez
ef16e1b41f
Add docs to loadtest with MDM enabled and configured (#11891) 2023-05-25 09:07:24 -03:00
Lucas Manuel Rodriguez
2c13f16db7
Add some improvements to the loadtesting environment (#11564)
The default max open conns (50) was causing issues with small DB
instances (`db.t4g.medium`) in loadtesting (we run 10 fleet instances,
and 500 was over the limit number of connections for that instance
type).

Also upgrading Redis version to a more recent version that users are
most likely using.
2023-05-12 13:43:15 -03:00
Zach Wasserman
1a521133f4
Upgrade Go version to 1.19.8 (#11057)
# Checklist for submitter

If some of the following don't apply, delete the relevant line.

- [x] Changes file added for user-visible changes in `changes/` or
`orbit/changes/`.
See [Changes
files](https://fleetdm.com/docs/contributing/committing-changes#changes-files)
for more information.
2023-04-07 12:05:22 -07:00
KanchiMoe
12e2047af9
replication_group_description is deprecated (#11047)
`replication_group_description` is a deprecated argument for
`aws_elasticache_replication_group`.
The replacement is `description`.

Highlighted on this job:
https://github.com/fleetdm/fleet/actions/runs/4613224383/jobs/8154983457#step:4:54

---
From:
https://registry.terraform.io/providers/hashicorp/aws/latest/docs/resources/elasticache_replication_group#argument-reference

> `replication_group_description` – (Deprecated use `description`
instead) User-created description for the replication group. Must not be
empty.
2023-04-06 19:44:10 -04:00
KanchiMoe
8c10b54388
number_cache_clusters is a deprecated argument in loadtesting/redis.tf (#10979)
`number_cache_clusters` is a deprecated argument for
`aws_elasticache_replication_group`.
The replacement is `num_cache_clusters`.

Highlighted on this job:
https://github.com/fleetdm/fleet/actions/runs/4600246486/jobs/8126589394#step:4:54

---
From
https://registry.terraform.io/providers/hashicorp/aws/latest/docs/resources/elasticache_replication_group#argument-reference:

> `number_cache_clusters` - (Optional, Deprecated use
`num_cache_clusters` instead)
2023-04-04 19:59:44 -04:00
KanchiMoe
a0b10d4e49
acl is deprecated on aws_s3_bucket (#10944)
`acl` is a deprecated argument on `aws_s3_bucket`.

Identified by this job:
https://github.com/fleetdm/fleet/actions/runs/4585758981/jobs/8098079111#step:4:58
2023-04-03 14:53:13 -04:00
KanchiMoe
23fe4bc718
lifecycle_rule on aws_s3_bucket is deprecated on loadtesting/firehose.tf (#10929)
`lifecycle_rule` on `aws_s3_bucket` is a deprecated argument.

Highlighted in this job:
https://github.com/fleetdm/fleet/actions/runs/4583725754/jobs/8094753489#step:4:57
2023-04-01 19:37:59 -04:00
Zachary Winnerman
14f9c14a84
Fix rds deprecations in loadtesting (#10922)
# Checklist for submitter

If some of the following don't apply, delete the relevant line.

- [ ] Changes file added for user-visible changes in `changes/` or
`orbit/changes/`.
See [Changes
files](https://fleetdm.com/docs/contributing/committing-changes#changes-files)
for more information.
- [ ] Documented any API changes (docs/Using-Fleet/REST-API.md or
docs/Contributing/API-for-contributors.md)
- [ ] Documented any permissions changes
- [ ] Input data is properly validated, `SELECT *` is avoided, SQL
injection is prevented (using placeholders for values in statements)
- [ ] Added support on fleet's osquery simulator `cmd/osquery-perf` for
new osquery data ingestion features.
- [ ] Added/updated tests
- [ ] Manual QA for all new/changed functionality
  - For Orbit and Fleet Desktop changes:
- [ ] Manual QA must be performed in the three main OSs, macOS, Windows
and Linux.
- [ ] Auto-update manual QA, from released version of component to new
version (see [tools/tuf/test](../tools/tuf/test/README.md)).

Closes #10869
2023-03-31 16:11:21 -04:00
KanchiMoe
56187894e6
firehose.tf acl argument on aws_s3_bucket is deprecated (#10906)
The `acl` argument on `aws_s3_bucket` is deprecated, as noted by the
warning on this job:
https://github.com/fleetdm/fleet/actions/runs/4568874872/jobs/8064463410#step:4:54
2023-03-30 19:58:21 -04:00
KanchiMoe
c56677af10
firehose.tf lifecycle_rule on "osquery-results" is deprecated (#10898)
`lifecycle_rule` on s3 buckets is deprecated, as noted by the warning on
this job:
https://github.com/fleetdm/fleet/actions/runs/4568578149/jobs/8063810135#step:4:54
2023-03-30 16:54:59 -04:00
Benjamin Edwards
4161ee5679
create vuln processing addon (#10526)
two things here:

1. create addon for use in new modular terraform
2. create vuln processing terraform for legacy terraform, but by default
its disabled
2023-03-29 08:57:10 -04:00
Robert Fairburn
e4803819a1
Update references from fleet-infra to confidential (#10388)
Updates to support https://github.com/fleetdm/fleet/issues/10330
2023-03-08 12:38:40 -06:00
Martin Angers
e3ddb5f3ce
Support matching a host in orbit enrollment using the serial number (#9612) 2023-02-28 12:55:04 -05:00
Luke Heath
71f2a62b4c
Prepare for 4.28.0 (#10103) 2023-02-27 15:19:15 -08:00
Luke Heath
13e821d059
Prepare for 4.27.1 (#9885) 2023-02-17 19:19:02 -08:00
Lucas Manuel Rodriguez
c6ab010833
Amend the loadtesting README.md (#9650)
Amending some parts of the README.md after following the guide to load
test #9559.

PS: Great documentation we have here!
2023-02-06 06:54:44 -03:00
Luke Heath
b3daf3d715
Prepare for 4.27.0 (#9683) 2023-02-03 17:03:06 -08:00
Zachary Winnerman
3ba801a43b
Quick fixup (#9614)
# Checklist for submitter

If some of the following don't apply, delete the relevant line.

- [ ] Changes file added for user-visible changes in `changes/` or
`orbit/changes/`.
See [Changes
files](https://fleetdm.com/docs/contributing/committing-changes#changes-files)
for more information.
- [ ] Documented any API changes (docs/Using-Fleet/REST-API.md or
docs/Contributing/API-for-contributors.md)
- [ ] Documented any permissions changes
- [ ] Input data is properly validated, `SELECT *` is avoided, SQL
injection is prevented (using placeholders for values in statements)
- [ ] Added support on fleet's osquery simulator `cmd/osquery-perf` for
new osquery data ingestion features.
- [ ] Added/updated tests
- [ ] Manual QA for all new/changed functionality
  - For Orbit and Fleet Desktop changes:
- [ ] Manual QA must be performed in the three main OSs, macOS, Windows
and Linux.
- [ ] Auto-update manual QA, from released version of component to new
version (see [tools/tuf/test](../tools/tuf/test/README.md)).
2023-02-01 12:40:12 -05:00
Robert Fairburn
68673cfa6a
Initial osquery-perf terraform module addon (#9556)
Added some outputs to re-use the execution and other iam roles in terraform module.
Added osquery-perf addon terraform module
2023-01-31 15:28:57 -06:00
Luke Heath
b6a6ac454f
Prepare for 4.26.0 (#9326) 2023-01-13 16:26:22 -08:00
Zachary Winnerman
da7329cbcd
Add fix for destroying loadtesting ECR (#9154) 2023-01-02 16:07:37 -05:00
Robert Fairburn
b19233e21d
Loadtesting db size (#9152)
* Allow for customizable DB instance type loadtesting
2023-01-02 14:33:30 -06:00
Zachary Winnerman
d64728a5b1
Fix tags for loadtesting (#9151) 2023-01-02 15:21:10 -05:00
Robert Fairburn
75ea8b8b88
Allow loadtests to separate git branch from dockerhub tag (#9130) 2022-12-27 15:48:54 -06:00
Luke Heath
dd29a4e718
Bump loadtest aurora version to latest (#9120) 2022-12-23 15:59:30 -06:00
Tomas Touceda
71dbb71df4
Update go to 1.19.4 (#8945)
* Update go to 1.19.4

* Comment out failing package test

* Comment out ALL the packaging tests for windows for the moment

* Update go to 1.19.4

* Comment out failing package test

* Comment out ALL the packaging tests for windows for the moment

* Update changelog

* Bump versions

* Update changelog to reflect this being a security release
2022-12-09 11:47:17 -03:00