Commit Graph

302 Commits

Author SHA1 Message Date
Zachary Winnerman
114e97ba6c
Make code match what we are running in prod for sandbox timeout (#9169) 2023-01-03 19:37:19 -05:00
Zachary Winnerman
9ff51fdce8
Bump provider version and module versions (#9168)
* Bump provider version and module versions

* fixup
2023-01-03 19:27:20 -05:00
Zachary Winnerman
da7329cbcd
Add fix for destroying loadtesting ECR (#9154) 2023-01-02 16:07:37 -05:00
Robert Fairburn
b19233e21d
Loadtesting db size (#9152)
* Allow for customizable DB instance type loadtesting
2023-01-02 14:33:30 -06:00
Zachary Winnerman
d64728a5b1
Fix tags for loadtesting (#9151) 2023-01-02 15:21:10 -05:00
Zachary Winnerman
8687136c91
Allow workspace delete to work (#9150) 2023-01-02 15:04:05 -05:00
Zachary Winnerman
aedb0424a2
Add prevent destroy to rds via null resource (#9126)
* Add prevent destroy to rds via null resource

* fixup

* fixup2
2022-12-28 04:12:03 -05:00
Robert Fairburn
75ea8b8b88
Allow loadtests to separate git branch from dockerhub tag (#9130) 2022-12-27 15:48:54 -06:00
Luke Heath
dd29a4e718
Bump loadtest aurora version to latest (#9120) 2022-12-23 15:59:30 -06:00
Luke Heath
54e8b3e250
Prepare for 4.25.0 (#9113) 2022-12-22 15:13:24 -08:00
Tomas Touceda
71dbb71df4
Update go to 1.19.4 (#8945)
* Update go to 1.19.4

* Comment out failing package test

* Comment out ALL the packaging tests for windows for the moment

* Update go to 1.19.4

* Comment out failing package test

* Comment out ALL the packaging tests for windows for the moment

* Update changelog

* Bump versions

* Update changelog to reflect this being a security release
2022-12-09 11:47:17 -03:00
Luke Heath
934f8cf734
Prepare for 4.24.0 (#8902) 2022-12-01 13:03:55 -06:00
Robert Fairburn
44609419b2
arm64 Mac support for loadtesting. Quickly expire loadtesting secrets on destroy (#8889) 2022-12-01 07:35:10 -06:00
Roberto Dip
665cac41f6
enable a reader replica in load testing RDS (#8805)
We discussed in the @fleetdm/g-platform weekly meeting that it would be good to have a read replica enabled by default in load testing, as it matches what we would recommend to customers for deployments of the size we use to load test with.

This is just what I did to get it working in the past, but I'm happy to adjust as you consider appropriate.
2022-11-23 16:13:57 -03:00
Robert Fairburn
5d7900b388
Add scripts to update sandbox easier (#8700)
* Add scripts to update sandbox easier

* Sort unclaimed instances in cleanup tool

* Sandbox readme update
2022-11-16 13:30:01 -06:00
Luke Heath
af0c75e08b
Prepare for 4.23.0 (#8663) 2022-11-14 14:42:21 -08:00
Zach Wasserman
efbe4c0777
Update Go to 1.19.3 (#8525) (#8614)
Co-authored-by: Tomas Touceda <chiiph@gmail.com>
2022-11-08 13:03:23 -03:00
Roberto Dip
f5d3aa233c
reduce the build time of loadtest.Dockerfile (#8584)
- yarn is not needed to build osquery-perf
- we can change the clone step to not fetch unnecessary data
2022-11-04 13:20:38 -03:00
Robert Fairburn
3c87299082
Improve loadtesting documentation (#8576) 2022-11-03 17:11:22 -05:00
Zachary Winnerman
6afcf161db
Guardduty (#8553)
* Added initial code for guard duty, tested some of it

* Add finished (*) guard duty code

* Removed temp workaround stuff
2022-11-03 13:59:35 -04:00
Zachary Winnerman
70524b6e3a
Sandbox data (#8523)
* Initial work on sandbox data pipeline

* Update python code to have preliminary code

* Added in final code for sandbox-data.
Huge delay because I needed to double check licensing
2022-11-01 12:41:13 -04:00
Roberto Dip
c51927e873
enhance support for orbit and fleet desktop in osquery-perf (#8217)
This improves osquery-perf with support for a more realistic orbit + fleet desktop simulation as described in #8212

This was based on the work done by @sharvilshah in his branch.
2022-10-28 14:27:21 -03:00
Roberto Dip
feaf46a55a
cherry-pick changes from fleet-v4.22.1 (#8481) 2022-10-28 12:24:30 -03:00
Benjamin Edwards
08b2ab5c18
update deployment guide (#8447)
* update deployment guide and add additional descriptions/comments for terraform resources

* add architecture diagram to deployment guide
2022-10-26 15:52:54 -04:00
Noah Talerman
90f5fbb63a
Prepare for 4.22 (#8253) 2022-10-21 11:24:13 -07:00
Robert Fairburn
dc0427117e
Add loadtesting ECR Cleanup one-liner (#8041) 2022-10-10 10:02:11 -05:00
Noah Talerman
e98941aeaf
Prepare for 4.21.0 (#8011)
This PR addresses the instructions under number (1) in the releasing Fleet steps: https://fleetdm.com/docs/contributing/releasing-fleet#what-to-do

- Update CHANGELOG
- Bump versions
2022-10-05 13:18:22 -07:00
Zachary Winnerman
5d001c90de
Bump provider versions for dogfood (#8027) 2022-09-29 13:58:23 -04:00
Zachary Winnerman
75e49e9740
Remove lifecycle part for rds, terraform doesn't support it (#8025) 2022-09-29 13:28:13 -04:00
Zachary Winnerman
891bdc0e24
Some quick fixes that I noticed deploying sandbox dev (#7948) 2022-09-29 11:15:33 -04:00
Martin Angers
7356378d0f
Update hashicorp/aws provider version for loadtesting and add CI validation (#7937)
* Update hashicorp/aws provider version for loadtesting and add CI validation

* Update name of the new workflow
2022-09-28 09:38:56 -05:00
KanchiMoe
cde973293b
server_side_encryption_configuration attribute is deprecated (#7866) 2022-09-21 14:25:08 -04:00
Zachary Winnerman
989db6bd25
Add fluentbit logging to sandbox EKS (#7880) 2022-09-21 13:44:49 -04:00
Zachary Winnerman
3525c3f897
Fix applies for rds terraform (#7862)
* Fix applies for rds terraform

* fixup
2022-09-20 17:09:24 -04:00
KanchiMoe
fc3f980cff
server_side_encryption_configuration argument is deprecated (#7577)
https://registry.terraform.io/providers/hashicorp/aws/latest/docs/resources/s3_bucket#enable-default-server-side-encryption
2022-09-19 13:04:52 -04:00
Robert Fairburn
897b750b55
Add how to obtain email addresses from a sandbox (#7821) 2022-09-17 13:17:44 -05:00
Zachary Winnerman
eeba487ea4
Add changes to clear activities table in sandbox (#7723)
* Add changes to clear activities table in sandbox

* fixup

* fixup

* fixup

* Finished testing in dev

* fixup

* fixup
2022-09-16 15:59:57 -04:00
Noah Talerman
dab45f1180
Prepare for 4.20.1 (#7783) 2022-09-15 14:28:23 -05:00
Zachary Winnerman
ac47c50ee8
Add sandbox dev stuff (#7782) 2022-09-15 13:33:49 -04:00
Zachary Winnerman
a1a80c775f
Upgrade database to mysql 8 compatible (#7703)
* Upgrade database to mysql 8 compatible

* fixup

* Added changelog for mysql8 upgrade
2022-09-15 13:29:59 -04:00
Tomas Touceda
8457e55b53
Bump go to 1.19.1 (#7690)
* Bump go to 1.19.1

* Bump remaining go-version to the 1.19.1

* Add extra paths for test-go

* Oops, putting the right path in the right place

* gofmt file

* gofmt ALL THE THINGS

* Moar changes

* Actually, go.mod doesn't like minor versions
2022-09-12 20:32:43 -03:00
Noah Talerman
26b610dde4
Prepare for 4.20.0 (#7651) 2022-09-09 16:01:03 -05:00
Noah Talerman
15a7f8a18c
Prepare for 4.19.1 (#7453) 2022-09-01 12:14:44 -05:00
Tomas Touceda
fa63c5b7ed
Update docs for ease of use and send alerts to help-p1 (#7477) 2022-08-31 11:25:35 -03:00
Robert Fairburn
cfe338dac7
Increase Elasticsearch VM size (#7447) 2022-08-30 12:34:15 -05:00
Zachary Winnerman
369c976e82
Quick sandbox fixup (#7386) 2022-08-24 11:49:39 -05:00
Robert Fairburn
6543c5d5ac
Sandbox to use v4.19.0 tag (#7385) 2022-08-24 11:25:31 -05:00
Zachary Winnerman
eca5d767e1
Increase probe timeouts so it can survive database scaling events (#7298) 2022-08-24 11:09:24 -05:00
Zachary Winnerman
f16f848a7b
noticed some tags being outdated in sandbox (#7382) 2022-08-24 12:09:16 -04:00
Zachary Winnerman
0b5a047da6
mark ecr as immutable in preperation for 4.19.0 release (#7324) 2022-08-24 12:09:53 +00:00
Noah Talerman
5ad3f9a2d6
Prepare for 4.19.0 (#7346)
- Add CHANGELOG
- Bump versioning
- Remove `changes/` files
2022-08-23 15:13:01 -04:00
Zachary Winnerman
1d83b2610c
Delete now defunct workspaces (#7322) 2022-08-19 18:27:05 +00:00
Robert Fairburn
402585476e
More sandbox docs (#7272)
* Add "Environment Access" to Sandbox Readme

* Add spacing in sandbox readme

* Additional Documentation
2022-08-17 14:26:55 -05:00
Zachary Winnerman
653f882c23
Add runbooks for sandbox (#7205)
* Add runbooks for sandbox

* Added a note on athena workgroup
2022-08-17 16:26:44 +00:00
Robert Fairburn
69c8eb088e
SandboxProd SSO access to EKS (#7172)
* SandboxProd SSO access to EKS

* Sandbox docker platform = linux/amd64

* Shorten SSO role ARN for EKS
2022-08-16 13:16:48 -05:00
Zachary Winnerman
d0aad25882
Added a redirect for instances that don't exist (#7168)
* Added a redirect for instances that don't exist

* fixup

* Switched to using ECR for fleet deployments instead of dockerhub
2022-08-12 17:43:13 -04:00
dependabot[bot]
6f0e0873ca
Bump golang from 1.18.4-bullseye to 1.19.0-bullseye (#7039)
* Bump golang from 1.18.4-bullseye to 1.19.0-bullseye

Bumps golang from 1.18.4-bullseye to 1.19.0-bullseye.

---
updated-dependencies:
- dependency-name: golang
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

* Update other golang deps as well

* Update missing go mods

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Tomas Touceda <chiiph@gmail.com>
2022-08-10 17:00:01 -03:00
Robert Fairburn
1f1ee964ab
Improve APM in Loadtesting (#7061)
* Initial cloudwatch stub for loadtesting/apm

* Fix duplicate policy attachment name

* elastichsearch pull keys from ssh secret

* Set aws region for run-ansible

* Alternate way to specify region in run-ansible

* Fix elasticsearch_ansible ssh file modes

* Cloudwatch agent config elasticsearch

* Fix ansible indents

* Set platform to linux/amd64 for loadtesting docker image

* Use /dev/sdb on elasticsearch/apm

* fixup

* elasticsearch volume mounted

* elasticapm increase shards and size

* Increase elasticapm instance size

* Document how to get the IP for APM ec2 instance
2022-08-10 12:33:49 -05:00
Zachary Winnerman
56910ea261
Add vuln database config for sandbox (#7126) 2022-08-10 09:22:13 -04:00
Zachary Winnerman
3a1c4e45f2
Add ALB logging for fleet sandbox (#7127)
Closes #7121
2022-08-09 13:38:14 -04:00
Zachary Winnerman
8b0b885613
Give fleet more memory (#7128) 2022-08-09 13:37:37 -04:00
Roberto Dip
8e554ca832
lock rcodesign version to 0.16.0 (#7113) 2022-08-09 14:07:13 -03:00
Zachary Winnerman
f1d76d7e24
Testing applying basic config to sandbox instances (#7105)
* Testing applying basic config to sandbox instances

* fixup

* Consistency nit from @lucasmrod
2022-08-09 12:24:10 -03:00
Roberto Dip
d3e2e2dca0
enable notarization on Sandbox pre-provisioner (#7100) 2022-08-08 14:25:01 -04:00
Zachary Winnerman
82ba1a00a2
Demo packaging (#7020)
* checkin for testing

* Initial work on packaging, still need to configure fleet to use it

* Add the terraform stuff for installers

* Add iam permissions for packaging

* Add environment variables for installers to fleet

* Implement review fixes

* Add an extra state for provisioned, but not ready for customers

* Add secretsmanager stuff for apple

* fixup

* fixup

* Bugfixes

* fixup

* fixup and added some stuff to the readdme

* Add link to openapi.json in readme
2022-08-05 11:41:41 -04:00
Zachary Winnerman
b2d94b1cc5
Add some oneliners for cleaning up fleet sandbox (#7043) 2022-08-03 19:01:45 -04:00
Zachary Winnerman
af5a1c7d2c
Change fleet org to "Fleet Sandbox" (#7042)
Closes #7016
2022-08-03 16:53:27 -04:00
Katheryn Satterlee
4bcd14dc83
Fleet 4.18.0 changelog (#6951) 2022-08-01 13:39:13 -07:00
Zach Wasserman
6002324139
Bring 4.17.1 changelog into main (#6901) 2022-08-01 10:50:40 -07:00
Roberto Dip
90b723e45a
consolidate sandbox env flags (#6917)
Related to #6894, this entirely replaces FLEET_DEMO with the server config added in #6597

As part of this, I also implemented a small refactor to the integration test suite to allow setting a custom config when the server is initialized.
2022-07-27 16:47:39 -03:00
Zachary Winnerman
e2f2a4cb57
Fix monitoring IAM permissions (#6926) 2022-07-27 15:46:36 -04:00
Zachary Winnerman
7ff2c3d249
Add cors to sandbox jitprovisioner (#6900) 2022-07-26 16:30:44 -05:00
Luke Heath
6c1d74f14f
Update sandbox env var and capitilization (#6896) 2022-07-26 13:58:00 -07:00
Luke Heath
6804cc2a1f
Change terraform sandbox deploy tag to main (#6880)
* Change terraform sandbox deploy tag to main

* Add image pull policy

Co-authored-by: zwinnerman-fleetdm <zwinnerman@fleetdm.com>
2022-07-26 09:44:38 -07:00
Zachary Winnerman
913acdc2ae
Add auth header requirement for /new and fix openapi spec for timestamp (#6855) 2022-07-25 16:26:04 -04:00
Robert Fairburn
126fedfcd3
Allow VPN Access into Dogfood (#6805) 2022-07-21 13:38:50 -05:00
Zachary Winnerman
9338fcbcbd
Fleet Sandbox (#5079)
* Add code for the shared infra part of the demo environment

* Checkin

* checkin

* Checkin for pre-provisioner, got terraform working

* Checkin with the pre-deployer working, now blocked by helm chart

* Add interface for helm

* Add some initial code for the JIT Provisioner lambda

Lots of code taken from https://gitlab.com/hmajid2301/articles/-/tree/master/41.%20Create%20a%20webapp%20with%20fizz

* Update helm chart to work with shared infra (#5621)

* Update helm chart to work with shared infra

* Update helm chart README to reflect changes.

* Checkin

* Checkin

* Checkin, Pre-provisioner actually works

* PreProvisioner is now complete

* Make changes to the JIT provisioner based off of actually learning how
to do stuff

* checkin

* Check in, broken currently

* Add all code except provisioning and emailing user

* Checkin

* Checkin, fixed kubernetes

* Checkin

* Forgot a file

* Finish jit provisioner, need to test now

* Checkin, switching to nginx ingress

* Fleets are now actually accessible

* JITProvisioner now returns working fleet instances

* Deprovisioner code done, just need a few bugs fixed

* Fix the deprovisioner so it works now and re-ip

* fixup

* Finished testing the deprovisioner

* Added monitoring and fixed some bugs

* Add stuff for #6548

* fixed per luke's suggestion

* Fix for inactive task definition arns

* move everything to the prod account

* Bump fleet version and fix a couple of bugs

* Fix a couple of bugs

* Lots of security fixes and a few bug fixes

* Rename demo to sandbox to match product's naming

* Revert "Update helm chart to work with shared infra (#5621)"

This reverts commit 610bbd1c00338620f6cc65fe2aff86139551f465.

Co-authored-by: Robert Fairburn <8029478+rfairburn@users.noreply.github.com>
2022-07-19 13:56:53 -05:00
Robert Fairburn
7afef3f035
Re-IP Loadtesting for TGW+VPN (#6635)
* Re-IP Loadtesting for TGW+VPN

* Further restrict VPN IPs for LoadTesting

* Update VPN IPs for Loadtesting
2022-07-19 13:25:14 -05:00
Zachary Winnerman
5edd551e2d
Add account perms for fleet cloud sandbox (#6615) 2022-07-12 12:48:14 -04:00
Zachary Winnerman
be9974acfb
Add stuff for the new infra state (#5731) 2022-07-12 12:36:02 -04:00
Benjamin Edwards
dc40c80e2e
add tf vars for cloudwatch log retention & rds snapshot backup retention (#6532)
* add tf vars for cloudwatch log retention & rds snapshot backup retention, update github workflow to deploy new dogfood configurations for new tf vars

* typo and tf fmt
2022-07-11 15:30:36 -04:00
Katheryn Satterlee
b9d749f37b
Changelog for Fleet 4.17.0 release (#6565) 2022-07-08 17:09:02 -07:00
Rod Christiansen
b1465bfa59
Suggested change for set recovery window to 0 (#6278)
Suggesting setting the key so failed builds can be re-applied without errors. If your terraform build fails and you need to destroy and re-apply, without a recovery window of 0, Secret Manager doesn't allow you to delete the secret and that named secret has to wait 7 days to be deleted.
2022-06-27 09:40:59 -05:00
Benjamin Edwards
65c0c39edf
fix falling edge monitoring of loadbalancer 5XX alarm (#6346) 2022-06-23 09:41:08 -04:00
Katheryn Satterlee
865ab32d03
Prepare for 4.16.0 release (#6256) 2022-06-20 20:55:33 -07:00
Zachary Winnerman
34bfe71674
Loadtest test (#6218)
* testing

* another fix

* Revert "add changes file"

This reverts commit bc2402348e2e6d6e7252ef899dd899b758379003.

* revert 71e1639531832217500fafcec32df781f22d85e7

Co-authored-by: Roberto Dip <dip.jesusr@gmail.com>
2022-06-14 15:39:49 +00:00
Noah Talerman
d17a8151b4
Prepare for 4.15.0 (#5858)
Co-authored-by: Katheryn Satterlee <me@ksatter.com>
Co-authored-by: Zach Wasserman <zach@fleetdm.com>
2022-05-27 16:50:20 -03:00
Zachary Winnerman
baaccaadb7
quick fixup for loadtesting (#5940)
* quick fixup for loadtesting

* fixup
2022-05-27 15:35:41 -04:00
Zachary Winnerman
3be4c9c353
Allow rds access from jump box sg (#5920) 2022-05-26 14:24:57 -05:00
Benjamin Edwards
58d2b66042
add github action deploy via OIDC credentials (#5339)
* remove unused iam poilcy attributes and remove github action on pull request, only workflow dispatch will be required
* update github.tf, commenting out all resources, but leaving in place in case someone else wants to use ODIC providers & Github actions
2022-05-25 14:03:29 -04:00
Martin Angers
2f53bac1aa
Update load testing README doc with additional information. (#5794) 2022-05-24 14:36:14 -04:00
Zachary Winnerman
d84d6008c3
Quick fixup for elasticsearch (#5669) 2022-05-11 10:12:24 -05:00
Noah Talerman
12b1a159b5
Prepare for 4.14.0 (#5589)
* Add changelog and bump versions

* Update changelog

* Bump version in example Kubernetes YAML

* Add last_opened_at entry to changelog
2022-05-09 18:14:01 -03:00
Robert Fairburn
445dc89175
loadtest fix elastisearch path/alb subdomain hint (#5554) 2022-05-05 10:02:35 -05:00
Zachary Winnerman
3b9208c42a
Updated readme to reflect terraform loadtesting changes (#5530) 2022-05-04 10:27:26 -05:00
Zachary Winnerman
e5adb9ae9c
Made changes so that we have a per-environment internal load balancer (#5534) 2022-05-04 10:26:11 -05:00
Zachary Winnerman
e7b9f41097
Added support for multipule loadtest environments (#5526) 2022-05-03 09:51:11 -05:00
Zach Wasserman
64b6f748fe
Updates for Fleet 4.13.2 (#5361)
Co-authored-by: Michal Nicpon <michal@fleetdm.com>
2022-04-25 14:54:25 -07:00
Tomas Touceda
427798b279
Update changelog for 4.13.1 (#5252) 2022-04-20 16:44:17 -07:00
Noah Talerman
1d0d92c865
Prepare for 4.13.0 (#5193) 2022-04-18 15:49:19 -07:00
Zach Wasserman
61a4d03f96
Update changelog for Fleet v4.12.1 (#4942) 2022-04-18 14:41:14 -04:00
Zachary Winnerman
2fbe53b6c9
Reorg infrastructure and add changes for frontend's loadtesting environment (#4947)
* Reorganized infrastructure, updated for frontend's loadtesting

* Add changes suggested by @chiiph

* Moved files per suggestion by Ben

* Update docs with new links

* Add config for multi account assume role
2022-04-12 12:49:00 -04:00