Commit Graph

53 Commits

Author SHA1 Message Date
Roberto Dip
ab9ac28538
upgrade go version to 1.19.10 (#12187)
for #12177
2023-06-07 17:59:30 -03:00
Luke Heath
1f8ca0bbb4
Use personal access token for workflows (#12118) 2023-06-02 16:23:23 -05:00
Lucas Manuel Rodriguez
ef16e1b41f
Add docs to loadtest with MDM enabled and configured (#11891) 2023-05-25 09:07:24 -03:00
Lucas Manuel Rodriguez
2c13f16db7
Add some improvements to the loadtesting environment (#11564)
The default max open conns (50) was causing issues with small DB
instances (`db.t4g.medium`) in loadtesting (we run 10 fleet instances,
and 500 was over the limit number of connections for that instance
type).

Also upgrading Redis version to a more recent version that users are
most likely using.
2023-05-12 13:43:15 -03:00
Zach Wasserman
1a521133f4
Upgrade Go version to 1.19.8 (#11057)
# Checklist for submitter

If some of the following don't apply, delete the relevant line.

- [x] Changes file added for user-visible changes in `changes/` or
`orbit/changes/`.
See [Changes
files](https://fleetdm.com/docs/contributing/committing-changes#changes-files)
for more information.
2023-04-07 12:05:22 -07:00
KanchiMoe
12e2047af9
replication_group_description is deprecated (#11047)
`replication_group_description` is a deprecated argument for
`aws_elasticache_replication_group`.
The replacement is `description`.

Highlighted on this job:
https://github.com/fleetdm/fleet/actions/runs/4613224383/jobs/8154983457#step:4:54

---
From:
https://registry.terraform.io/providers/hashicorp/aws/latest/docs/resources/elasticache_replication_group#argument-reference

> `replication_group_description` – (Deprecated use `description`
instead) User-created description for the replication group. Must not be
empty.
2023-04-06 19:44:10 -04:00
KanchiMoe
8c10b54388
number_cache_clusters is a deprecated argument in loadtesting/redis.tf (#10979)
`number_cache_clusters` is a deprecated argument for
`aws_elasticache_replication_group`.
The replacement is `num_cache_clusters`.

Highlighted on this job:
https://github.com/fleetdm/fleet/actions/runs/4600246486/jobs/8126589394#step:4:54

---
From
https://registry.terraform.io/providers/hashicorp/aws/latest/docs/resources/elasticache_replication_group#argument-reference:

> `number_cache_clusters` - (Optional, Deprecated use
`num_cache_clusters` instead)
2023-04-04 19:59:44 -04:00
KanchiMoe
a0b10d4e49
acl is deprecated on aws_s3_bucket (#10944)
`acl` is a deprecated argument on `aws_s3_bucket`.

Identified by this job:
https://github.com/fleetdm/fleet/actions/runs/4585758981/jobs/8098079111#step:4:58
2023-04-03 14:53:13 -04:00
KanchiMoe
23fe4bc718
lifecycle_rule on aws_s3_bucket is deprecated on loadtesting/firehose.tf (#10929)
`lifecycle_rule` on `aws_s3_bucket` is a deprecated argument.

Highlighted in this job:
https://github.com/fleetdm/fleet/actions/runs/4583725754/jobs/8094753489#step:4:57
2023-04-01 19:37:59 -04:00
Zachary Winnerman
14f9c14a84
Fix rds deprecations in loadtesting (#10922)
# Checklist for submitter

If some of the following don't apply, delete the relevant line.

- [ ] Changes file added for user-visible changes in `changes/` or
`orbit/changes/`.
See [Changes
files](https://fleetdm.com/docs/contributing/committing-changes#changes-files)
for more information.
- [ ] Documented any API changes (docs/Using-Fleet/REST-API.md or
docs/Contributing/API-for-contributors.md)
- [ ] Documented any permissions changes
- [ ] Input data is properly validated, `SELECT *` is avoided, SQL
injection is prevented (using placeholders for values in statements)
- [ ] Added support on fleet's osquery simulator `cmd/osquery-perf` for
new osquery data ingestion features.
- [ ] Added/updated tests
- [ ] Manual QA for all new/changed functionality
  - For Orbit and Fleet Desktop changes:
- [ ] Manual QA must be performed in the three main OSs, macOS, Windows
and Linux.
- [ ] Auto-update manual QA, from released version of component to new
version (see [tools/tuf/test](../tools/tuf/test/README.md)).

Closes #10869
2023-03-31 16:11:21 -04:00
KanchiMoe
56187894e6
firehose.tf acl argument on aws_s3_bucket is deprecated (#10906)
The `acl` argument on `aws_s3_bucket` is deprecated, as noted by the
warning on this job:
https://github.com/fleetdm/fleet/actions/runs/4568874872/jobs/8064463410#step:4:54
2023-03-30 19:58:21 -04:00
KanchiMoe
c56677af10
firehose.tf lifecycle_rule on "osquery-results" is deprecated (#10898)
`lifecycle_rule` on s3 buckets is deprecated, as noted by the warning on
this job:
https://github.com/fleetdm/fleet/actions/runs/4568578149/jobs/8063810135#step:4:54
2023-03-30 16:54:59 -04:00
Benjamin Edwards
4161ee5679
create vuln processing addon (#10526)
two things here:

1. create addon for use in new modular terraform
2. create vuln processing terraform for legacy terraform, but by default
its disabled
2023-03-29 08:57:10 -04:00
Robert Fairburn
e4803819a1
Update references from fleet-infra to confidential (#10388)
Updates to support https://github.com/fleetdm/fleet/issues/10330
2023-03-08 12:38:40 -06:00
Martin Angers
e3ddb5f3ce
Support matching a host in orbit enrollment using the serial number (#9612) 2023-02-28 12:55:04 -05:00
Luke Heath
71f2a62b4c
Prepare for 4.28.0 (#10103) 2023-02-27 15:19:15 -08:00
Luke Heath
13e821d059
Prepare for 4.27.1 (#9885) 2023-02-17 19:19:02 -08:00
Lucas Manuel Rodriguez
c6ab010833
Amend the loadtesting README.md (#9650)
Amending some parts of the README.md after following the guide to load
test #9559.

PS: Great documentation we have here!
2023-02-06 06:54:44 -03:00
Luke Heath
b3daf3d715
Prepare for 4.27.0 (#9683) 2023-02-03 17:03:06 -08:00
Zachary Winnerman
3ba801a43b
Quick fixup (#9614)
# Checklist for submitter

If some of the following don't apply, delete the relevant line.

- [ ] Changes file added for user-visible changes in `changes/` or
`orbit/changes/`.
See [Changes
files](https://fleetdm.com/docs/contributing/committing-changes#changes-files)
for more information.
- [ ] Documented any API changes (docs/Using-Fleet/REST-API.md or
docs/Contributing/API-for-contributors.md)
- [ ] Documented any permissions changes
- [ ] Input data is properly validated, `SELECT *` is avoided, SQL
injection is prevented (using placeholders for values in statements)
- [ ] Added support on fleet's osquery simulator `cmd/osquery-perf` for
new osquery data ingestion features.
- [ ] Added/updated tests
- [ ] Manual QA for all new/changed functionality
  - For Orbit and Fleet Desktop changes:
- [ ] Manual QA must be performed in the three main OSs, macOS, Windows
and Linux.
- [ ] Auto-update manual QA, from released version of component to new
version (see [tools/tuf/test](../tools/tuf/test/README.md)).
2023-02-01 12:40:12 -05:00
Robert Fairburn
68673cfa6a
Initial osquery-perf terraform module addon (#9556)
Added some outputs to re-use the execution and other iam roles in terraform module.
Added osquery-perf addon terraform module
2023-01-31 15:28:57 -06:00
Luke Heath
b6a6ac454f
Prepare for 4.26.0 (#9326) 2023-01-13 16:26:22 -08:00
Zachary Winnerman
da7329cbcd
Add fix for destroying loadtesting ECR (#9154) 2023-01-02 16:07:37 -05:00
Robert Fairburn
b19233e21d
Loadtesting db size (#9152)
* Allow for customizable DB instance type loadtesting
2023-01-02 14:33:30 -06:00
Zachary Winnerman
d64728a5b1
Fix tags for loadtesting (#9151) 2023-01-02 15:21:10 -05:00
Robert Fairburn
75ea8b8b88
Allow loadtests to separate git branch from dockerhub tag (#9130) 2022-12-27 15:48:54 -06:00
Luke Heath
dd29a4e718
Bump loadtest aurora version to latest (#9120) 2022-12-23 15:59:30 -06:00
Tomas Touceda
71dbb71df4
Update go to 1.19.4 (#8945)
* Update go to 1.19.4

* Comment out failing package test

* Comment out ALL the packaging tests for windows for the moment

* Update go to 1.19.4

* Comment out failing package test

* Comment out ALL the packaging tests for windows for the moment

* Update changelog

* Bump versions

* Update changelog to reflect this being a security release
2022-12-09 11:47:17 -03:00
Robert Fairburn
44609419b2
arm64 Mac support for loadtesting. Quickly expire loadtesting secrets on destroy (#8889) 2022-12-01 07:35:10 -06:00
Roberto Dip
665cac41f6
enable a reader replica in load testing RDS (#8805)
We discussed in the @fleetdm/g-platform weekly meeting that it would be good to have a read replica enabled by default in load testing, as it matches what we would recommend to customers for deployments of the size we use to load test with.

This is just what I did to get it working in the past, but I'm happy to adjust as you consider appropriate.
2022-11-23 16:13:57 -03:00
Zach Wasserman
efbe4c0777
Update Go to 1.19.3 (#8525) (#8614)
Co-authored-by: Tomas Touceda <chiiph@gmail.com>
2022-11-08 13:03:23 -03:00
Roberto Dip
f5d3aa233c
reduce the build time of loadtest.Dockerfile (#8584)
- yarn is not needed to build osquery-perf
- we can change the clone step to not fetch unnecessary data
2022-11-04 13:20:38 -03:00
Robert Fairburn
3c87299082
Improve loadtesting documentation (#8576) 2022-11-03 17:11:22 -05:00
Roberto Dip
c51927e873
enhance support for orbit and fleet desktop in osquery-perf (#8217)
This improves osquery-perf with support for a more realistic orbit + fleet desktop simulation as described in #8212

This was based on the work done by @sharvilshah in his branch.
2022-10-28 14:27:21 -03:00
Robert Fairburn
dc0427117e
Add loadtesting ECR Cleanup one-liner (#8041) 2022-10-10 10:02:11 -05:00
Martin Angers
7356378d0f
Update hashicorp/aws provider version for loadtesting and add CI validation (#7937)
* Update hashicorp/aws provider version for loadtesting and add CI validation

* Update name of the new workflow
2022-09-28 09:38:56 -05:00
KanchiMoe
cde973293b
server_side_encryption_configuration attribute is deprecated (#7866) 2022-09-21 14:25:08 -04:00
KanchiMoe
fc3f980cff
server_side_encryption_configuration argument is deprecated (#7577)
https://registry.terraform.io/providers/hashicorp/aws/latest/docs/resources/s3_bucket#enable-default-server-side-encryption
2022-09-19 13:04:52 -04:00
Tomas Touceda
8457e55b53
Bump go to 1.19.1 (#7690)
* Bump go to 1.19.1

* Bump remaining go-version to the 1.19.1

* Add extra paths for test-go

* Oops, putting the right path in the right place

* gofmt file

* gofmt ALL THE THINGS

* Moar changes

* Actually, go.mod doesn't like minor versions
2022-09-12 20:32:43 -03:00
Robert Fairburn
cfe338dac7
Increase Elasticsearch VM size (#7447) 2022-08-30 12:34:15 -05:00
dependabot[bot]
6f0e0873ca
Bump golang from 1.18.4-bullseye to 1.19.0-bullseye (#7039)
* Bump golang from 1.18.4-bullseye to 1.19.0-bullseye

Bumps golang from 1.18.4-bullseye to 1.19.0-bullseye.

---
updated-dependencies:
- dependency-name: golang
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

* Update other golang deps as well

* Update missing go mods

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Tomas Touceda <chiiph@gmail.com>
2022-08-10 17:00:01 -03:00
Robert Fairburn
1f1ee964ab
Improve APM in Loadtesting (#7061)
* Initial cloudwatch stub for loadtesting/apm

* Fix duplicate policy attachment name

* elastichsearch pull keys from ssh secret

* Set aws region for run-ansible

* Alternate way to specify region in run-ansible

* Fix elasticsearch_ansible ssh file modes

* Cloudwatch agent config elasticsearch

* Fix ansible indents

* Set platform to linux/amd64 for loadtesting docker image

* Use /dev/sdb on elasticsearch/apm

* fixup

* elasticsearch volume mounted

* elasticapm increase shards and size

* Increase elasticapm instance size

* Document how to get the IP for APM ec2 instance
2022-08-10 12:33:49 -05:00
Robert Fairburn
7afef3f035
Re-IP Loadtesting for TGW+VPN (#6635)
* Re-IP Loadtesting for TGW+VPN

* Further restrict VPN IPs for LoadTesting

* Update VPN IPs for Loadtesting
2022-07-19 13:25:14 -05:00
Zachary Winnerman
34bfe71674
Loadtest test (#6218)
* testing

* another fix

* Revert "add changes file"

This reverts commit bc2402348e2e6d6e7252ef899dd899b758379003.

* revert 71e1639531832217500fafcec32df781f22d85e7

Co-authored-by: Roberto Dip <dip.jesusr@gmail.com>
2022-06-14 15:39:49 +00:00
Zachary Winnerman
baaccaadb7
quick fixup for loadtesting (#5940)
* quick fixup for loadtesting

* fixup
2022-05-27 15:35:41 -04:00
Zachary Winnerman
3be4c9c353
Allow rds access from jump box sg (#5920) 2022-05-26 14:24:57 -05:00
Martin Angers
2f53bac1aa
Update load testing README doc with additional information. (#5794) 2022-05-24 14:36:14 -04:00
Zachary Winnerman
d84d6008c3
Quick fixup for elasticsearch (#5669) 2022-05-11 10:12:24 -05:00
Robert Fairburn
445dc89175
loadtest fix elastisearch path/alb subdomain hint (#5554) 2022-05-05 10:02:35 -05:00
Zachary Winnerman
3b9208c42a
Updated readme to reflect terraform loadtesting changes (#5530) 2022-05-04 10:27:26 -05:00