Martin Angers
1e2059585a
Add support for google chrome profiles ( #3423 )
2021-12-21 15:36:19 -05:00
Lucas Manuel Rodriguez
93f4577c7d
Fix policy membership migration for MariaDB ( #3418 )
...
* Fix policy membership migration for MariaDB
* Use constraintsForTable to get the proper foreign key names
2021-12-21 14:39:46 -03:00
Martin Angers
a74e562893
Migrate labels endpoints to new pattern ( #3354 )
2021-12-21 09:53:15 -05:00
Tomas Touceda
39e71c6d77
Add mdm and munki ( #3406 )
...
* Draft for mdm and munki as direct ingest funcs
* Expose mdm/munki over API
* Add test for service and fix bug
* Update queries test
* Fix lint
* Address review comments
2021-12-21 09:37:58 -03:00
Lucas Manuel Rodriguez
5aeb418945
Exclude old data migration from the migrations check ( #3373 )
2021-12-16 10:52:42 -03:00
Martin Angers
af42a0850e
Migrate global scheduled queries endpoints to new pattern ( #3235 )
2021-12-15 09:06:34 -05:00
Martin Angers
0cc57bd294
Mna 1782 migrate endpoints ( #3226 )
2021-12-14 16:34:11 -05:00
Zach Wasserman
33797ddfc1
Optimize requests on packs page ( #3327 )
...
Improves #3259
2021-12-13 21:50:24 -08:00
Tomas Touceda
66f4fc46c0
Only join big tables when absolutely needed ( #3308 )
...
* Only join big tables when absolutely needed
* Fix test
* Revert unintended change in test
2021-12-09 17:36:12 -03:00
Lucas Manuel Rodriguez
d0765cb9ee
Do not exit on serve/prepare if there are unknown migrations ( #3262 )
...
* Do not exit on serve/prepare if there are unknown migrations
* PR review changes
2021-12-08 19:50:00 -03:00
Tomas Touceda
8686c1520b
Add index software ( #3241 )
...
* Add index to software over name/id
* Update schema
* Remove double semi colon
2021-12-07 16:36:13 -03:00
Lucas Manuel Rodriguez
edec1abc86
Remove platform and team from policy editing ( #3233 )
2021-12-07 13:01:00 -03:00
Lucas Manuel Rodriguez
6b8a2cb61a
Fix mysql8 compatibility with zero dates ( #3231 )
...
* Fix mysql8 compatibility with zero dates
* Amend date
2021-12-07 12:51:53 -03:00
Tomas Touceda
dc9686024b
Remove tx from SaveHost ( #3232 )
...
* Remove tx from SaveHost
Also change REPLACE for software for an insert.
* Remove bundle identifier from the get since it's not part of the key
* Revert unneeded change
2021-12-07 12:39:07 -03:00
gillespi314
6ee6dba4a4
Update anonymous usage statistics to record Fleet feature adoption ( #3056 )
...
* Collect additional anonymous usage statistics
* Update fleetdm.com and docs for usage stats
* Fix lint-go errors
* Fix failing test
* update webhook inputs
* Update receive-usage-analytics.js
* fix failing test
* Update statistics_test.go
Co-authored-by: eashaw <eashaw@sailsjs.com>
2021-12-06 14:39:00 -06:00
Lucas Manuel Rodriguez
c5375263b6
Change policy platforms name to platform singular (for consistency) ( #3221 )
...
* Change policy platforms name to platform singular
* Fix fleetctl tests
2021-12-06 13:56:28 -03:00
Martin Angers
b84ef79bf4
Add the fleetctl debug {errors,db-locks} sub-commands ( #3168 )
2021-12-06 09:26:01 -05:00
Lucas Manuel Rodriguez
b9a408704e
Add platforms field to policies ( #3181 )
...
* Add platforms field to policies
* Fix fleetctl tests
* PR review changes
* Add missing tests
* Add changes for ListPoliciesForHost
2021-12-03 15:33:33 -03:00
Tomas Touceda
142006cbdd
Issue 2099 enable vulnerability processing new installs ( #3104 )
...
* Enable vulnerability processing by default
* Add changes file
* Remove wrong env var
* Fix import
* Fix tests
* Update log line
* Remove unneeded import
2021-12-03 14:44:57 -03:00
Tomas Touceda
17bd4d5110
Remove policy membership history and only store the latest value ( #3178 )
...
* Remove policy membership history and only store the latest value
* Address review comments
* Correct error msg wrap
2021-12-03 13:10:11 -03:00
Tomas Touceda
5cff07f332
Issue 3184 drop event host expiry ( #3185 )
...
* Drop event host_expiry if it exists
* Add changes file
2021-12-03 12:34:58 -03:00
Tomas Touceda
a0404b6736
Add software count API ( #3105 )
...
* Add software count API
* Fix makefile
* Fine no mock generating at this point
* Actually, one last try
* Use go install instead
* Fix go sum/mod
* Improve documentation
* Try setting node to 14
2021-12-03 10:54:17 -03:00
Martin Angers
7464e72ba8
Move carves endpoints to new endpoint pattern ( #3148 )
2021-12-01 15:45:29 -05:00
Tomas Touceda
3a031e946d
Sort hostIDs before inserting seen time ( #3162 )
...
* Sort hostIDs before inserting seen time
* Fix status test
* Add comment
2021-12-01 16:20:54 -03:00
Lucas Manuel Rodriguez
e64a88d8b1
Add COALESCEs on all host_seen_times JOINs ( #3147 )
...
* Add COALESCEs on all host_seen_times JOINs
* Use tx instead of d.writer
* Add unit tests
* Fix compile test
2021-12-01 09:05:23 -03:00
Tomas Touceda
4ef9cfdf63
Increase grace period of status for hosts ( #3151 )
...
* Increase grace period of status for hosts
* Update tests
* Update more tests
2021-11-30 18:37:27 -03:00
Tomas Touceda
925d4df8f7
Add new disable_failing_policies query parameter to list hosts ( #3123 )
...
* Update documentation
* Update based on review comments
* Explain why the switch exists
2021-11-29 18:04:33 -03:00
Tomas Touceda
c82a8e8428
Sanitize OrderKey ( #3128 )
2021-11-29 18:03:19 -03:00
Tomas Touceda
036093874d
Add cursor pagination to list hosts ( #3120 )
...
* Add cursor pagination to list hosts
* Update docs
* Update based on review comments
2021-11-29 15:06:00 -03:00
Lucas Manuel Rodriguez
c6fc91f2e4
Fix ListPoliciesForHost, missing filter by teams ( #3106 )
...
* Fix ListPoliciesForHost, missing filter by teams
* Amend existing tests
2021-11-24 18:17:44 -03:00
Lucas Manuel Rodriguez
964f85b174
Amend policy creation and spec (for proprietary query), and add update APIs ( #2890 )
...
* Amend policy creation (proprietary query), add update APIs
* Fix Datastore.SavePolicy bug (and add tests)
* Add integration tests for new policy APIs
* Add author email
* Add activities
* Push breaking changes for return policy fields
* WIP
* Add integration test for host policies
* Make more improvements to policy representation
* Improve upgrade code (from PR review comments)
* PR changes
* Revert activities for policies
* Use *uint instead of uint for queryID, use fleet.PolicyPayload
* Filter out other schemas
* New policy flow (#2922 )
* created new policy flow -- no API connection
* added api props
* fixed prop name
* lint fixes
* removed unused modal; fixed style
* name, desc icons; created global components
* lint fixes
* ignoring certain files and lines for prettier
* Update frontend/pages/policies/PolicyPage/PolicyPage.tsx
* Make policy names unique across deployment
* Amend upgrade script
* Fix migration for unique names
* Do not deduplicate but instead rename policies
Co-authored-by: Martavis Parker <47053705+martavis@users.noreply.github.com>
2021-11-24 14:16:42 -03:00
Tomas Touceda
c65f8507fe
Remove host counts from software ( #3082 )
...
* Remove host counts from software
* Actually remove the host count from the struct
* Fix get test
2021-11-23 15:50:51 -03:00
Tomas Touceda
4cd9dab577
Update shell in host users when they exist ( #3072 )
2021-11-23 10:23:12 -03:00
Lucas Manuel Rodriguez
0642bfdb1d
Add fleetctl debug migrations command to get missing migrations ( #2967 )
...
* Add fleetctl command to get missing migrations
* Fix copy paste and lint
* Detect migrations applied out of order
* Add extra bullet to changes
* Trigger creation of migration status tables
* Fix unit tests
* PR fixes
* PR comment fixes
2021-11-22 14:06:12 -03:00
gillespi314
886b30fc4a
Remove five-row limit for teams search ( #3021 )
2021-11-22 09:30:55 -06:00
Tomas Touceda
887e42650b
Further optimize host select with policies ( #3013 )
...
* Further optimize host select with policies
* Add missing row close
* Improve migration
* Skip migration if column already exists
* Add test for host with/without extras
2021-11-18 14:36:35 -03:00
Lucas Manuel Rodriguez
cb54d9a8dc
Fix duplicate schedules and platform matching on scheduled queries ( #2977 )
...
* Fix duplicate schedules and platform matching on scheduled queries
* scheduled_queries.platform can be NULL
* Add unit tests
* Add rhel host and check zero stats
2021-11-17 19:03:30 -03:00
Tomas Touceda
ddbfb7f621
Allow sort by more than one key ( #2987 )
...
* Allow sort by more than one key
* Add test for multi sort
* Expand documentation
2021-11-17 16:37:26 -03:00
Tomas Touceda
77a91a7ab7
Add new index to policy_memership_history ( #2973 )
...
* Add new index to policy_memership_history
* Fix typos
2021-11-17 11:42:24 -03:00
Zach Wasserman
e279dc1682
Implement fleetctl updates rotate ( #2831 )
...
Add support for updating keys used in the TUF update system.
2021-11-15 10:01:48 -08:00
Martin Angers
a4b0d9d4a1
Add team_id to host summary when filtered for a specific team ( #2869 )
2021-11-15 09:56:13 -05:00
Martin Angers
f8d118af34
Add tests for hosts dynamic where clause ( #2882 )
2021-11-15 09:55:27 -05:00
Martin Angers
45168bed1d
Remove deprecated app_configs table ( #2884 )
2021-11-15 09:34:51 -05:00
Martin Angers
3ae57a0242
Create errors with ctxerr, add the call to store them in redis ( #2786 )
2021-11-15 09:11:38 -05:00
Lucas Manuel Rodriguez
1f560c56a2
Return all scheduled queries and their stats on the host fetch API ( #2855 )
...
* Return all scheduled queries and their stats on the host fetch API (pack_stats)
* Use 'pack' instead of null and wrap errs with ctxerr
2021-11-12 08:18:25 -03:00
Tomas Touceda
a0730ca643
Add update invite API ( #2837 )
2021-11-11 17:33:06 -03:00
gillespi314
3e2dad8caa
Add login shell information to host users table ( #2854 )
2021-11-11 11:26:03 -06:00
Tomas Touceda
b802af6f44
Add host count to software API ( #2879 )
...
* Add host count to software API
* Update docs
* Update fleetctl tests to account for host counts
* Update docs to mention host_count special case
* Update func comment
2021-11-11 08:49:17 -03:00
Tomas Touceda
88b32d8c7f
List policies for hosts even if they don't have stats ( #2865 )
2021-11-11 08:40:32 -03:00
Tomas Touceda
b95bb52c89
Issue 2868 ignore admin reset password sso ( #2877 )
...
* Ignore admin forced password reset if sso is enabled
* Add tests for authenticatedUser
* If SSOEnabled is true, then set AdminForcedPasswordReset to false
* Update tests to cover new password reset and sso flow
* Add changes file
2021-11-10 19:30:15 -03:00
Martin Angers
b7ed3589a8
Fix where clause building with right hosts alias ( #2875 )
2021-11-10 12:24:19 -05:00
Martin Angers
b57b64ccb2
Add total and per platform counts to host summary endpoint ( #2845 )
2021-11-09 09:35:36 -05:00
Lucas Manuel Rodriguez
bb187a7885
Fix flaky TestSoftware/filters_by_team_and_paginates ( #2835 )
2021-11-08 13:07:42 -03:00
Tomas Touceda
7db6de7278
Serialize hosts writes per instance ( #2753 )
...
* Serialize hosts writes per instance
* Write hosts asynchronously
* Dont make the save in a goroutine
* Revert "Dont make the save in a goroutine"
This reverts commit 4a890c5271142755dec69a741582e7eca5c4c62c.
* Make all savehosts async
* Address review comments and make this approach configurable
* Address review comments
* Disable bulk seen time marking for a test
* Move host seen times to a new table
* Remove unused
* Add seen_time to list hosts
* Add some jitter to seen time flushing
* Remove unused
* Add timeout to deferred save host
* Add tests for serialSaveHost
* Update hosts in labels and policy executions in a serial way
* Address review comments and remove fk constraints in host software
* Make errCh buffered
* Add changes file
* Readd key
2021-11-08 11:42:37 -03:00
Martin Angers
1b5ec19cf5
Add author_email to payload of queries (Get/List) ( #2798 )
2021-11-08 09:06:56 -05:00
Lucas Manuel Rodriguez
837bfed167
Try goqu as sql builder on listSoftwareDB ( #2773 )
...
* Try goqu as sql builder on listSoftwareDB
* Fix case insensitive search and add test
2021-11-04 15:21:39 -03:00
Martin Angers
a8735d55bb
Implement async processing of hosts for label queries ( #2288 )
2021-11-01 14:13:16 -04:00
Tomas Touceda
79f2c7c391
Issue 1798 rest api for live queries ( #2675 )
...
* wip
* wip
* Make tests not flaky
* Add changes file
* Make logging and authz thread safe
* Move cancel defer below err check
2021-10-26 11:33:31 -03:00
Lucas Manuel Rodriguez
3136cc105e
Replace into software to update empty bundle_identifier entries ( #2676 )
2021-10-26 09:48:25 -03:00
RachelElysia
36babcc510
UI feature: Frontend of performance impact bubbles ( #2589 )
...
Includes backend fixes and test
Co-authored-by: Tomas Touceda <chiiph@gmail.com>
2021-10-22 16:05:49 -04:00
Lucas Manuel Rodriguez
c84cbb1679
Fix SearchHosts to match for one-char and two-chars queries ( #2590 )
...
* Fix SearchHosts to match for one-char and two-chars queries
* Add issue number for future reference
2021-10-21 17:46:21 -03:00
Tomas Touceda
bcf6697741
Handle null resolution in host details ( #2622 )
...
* Handle null resolution in host details
* Add test for null resolution
2021-10-21 15:53:23 -03:00
Zach Wasserman
35523017c9
Make migrations compatible with GTID replication ( #2615 )
...
* Make migrations compatible with GTID replication
Fixes an issue some deployments encountered when migrations used a
statement that is unsupported in GTID replication mode (#2462 ).
Local dev MySQL now enforces this consistency, so it should be easier to
maintain compatibility going forward.
* Update docker-compose formatting
* if exists
2021-10-21 07:46:02 -03:00
Tomas Touceda
923d094471
Allow to skip loading CVEs in some cases ( #2611 )
2021-10-20 19:26:25 -03:00
Tomas Touceda
c2696c1261
Issue 1892 query perf everywhere ( #2580 )
...
* wip
* wip
* wip
* Add performance stats
* Add docs and other self review fixes
* lint
* Update based on review comments
* Add quick cleanup first and then reset to 1hr
* Reduce the load in the test
2021-10-20 18:35:38 -03:00
Tomas Touceda
cbe931c0e9
Add vulnerable filter for software and also wire up the query search ( #2604 )
...
* Add vulnerable filter for software and also wire up the query search
* Add documentation
* Update to use software list options
2021-10-20 18:01:20 -03:00
Tomas Touceda
86b1926d7c
Add missing join condition ( #2586 )
2021-10-20 13:24:51 -03:00
Tomas Touceda
c3f7577bd8
Add query description and resolution to the list of policies in hosts ( #2584 )
...
* Add query description and resolution to the list of policies in hosts
* Add docs
* Fix get host tests
2021-10-20 12:07:16 -03:00
Martin Angers
07cf136d03
Add TLS support to Redis connections ( #2568 )
2021-10-20 10:09:18 -04:00
Tomas Touceda
fe5660e006
Reimplement host expiration to not need mysql events ( #2552 )
...
* Reimplement host expiration to not need mysql events
* Update mocks
2021-10-19 17:47:37 -03:00
Tomas Touceda
b783b5721f
Add RoleAdmin to ValidTeamRoles for verification ( #2551 )
2021-10-18 11:38:47 -03:00
Tomas Touceda
74960d74be
Update calls to new signature ( #2536 )
2021-10-15 10:48:44 -03:00
Tomas Touceda
89c6d18ed2
Issue 2293 reveal failing policies list host ( #2528 )
...
* Add host issues
* Update docs
* Remove comment
* Update tests
2021-10-15 07:34:30 -03:00
Tomas Touceda
d3a0d62902
Issue 2456 policies yaml ( #2512 )
...
* wip
* Add policy specs support
* Add documentation
* Make policy apply idempotent
* Fold in code
* Improve tests and simplify auth checks
* Lint and fix test
2021-10-15 07:34:11 -03:00
Tomas Touceda
bb1dc401a3
Load vulnerabilities alongisde the software ( #2518 )
...
* Load vulnerabilities alongisde the software
* Update docs
2021-10-14 13:51:41 -03:00
Zach Wasserman
4d6956b6cb
Remove usage of temporary table in migration ( #2515 )
...
Temporary tables were causing migration issues under some MySQL
configurations as discussed in #2462 .
2021-10-13 16:25:08 -07:00
Tomas Touceda
28be73c410
Add missing software in list hosts response ( #2492 )
2021-10-12 15:59:01 -03:00
Tomas Touceda
782f276e0b
Issue 2050 add software filter list hosts ( #2486 )
...
* Add software_id filter to list hosts
* Add integration test for API endpoint
* Add doc
* Simplify sql query
2021-10-12 11:38:12 -03:00
RachelElysia
981028705e
Sentence Case: Throughout UI, tests, validators, docs ( #2455 )
2021-10-11 10:58:27 -04:00
Tomas Touceda
0fd569ebaf
Move migrations around and add missing column only if not available ( #2461 )
...
* Move migrations around and add missing column only if not available
* Add changes file
* Remove debug print
* Remove wrong import
2021-10-08 15:41:52 -03:00
Tomas Touceda
876aa0e366
Add host count API ( #2356 )
...
* Add host count API
* Add rest api docs
* Add host count for labels and address review comments
* Add regex for id
2021-10-07 08:25:35 -03:00
Tomas Touceda
9b809a2d35
Issue 1890 host details policy ( #2410 )
...
* wip
* Add policies to hosts
2021-10-07 08:11:10 -03:00
Tomas Touceda
f44c809d85
Check env var along with app config for software inv ( #2406 )
2021-10-06 14:17:33 -03:00
Tomas Touceda
1af3803cdb
Load all host values from the db to prevent overwriting columns with empty vals ( #2394 )
2021-10-06 09:27:53 -03:00
Tomas Touceda
02b2c64b89
Make software list not flaky, hopefully ( #2387 )
2021-10-05 18:26:02 -03:00
Tomas Touceda
70cf7aa0a0
Delete policies for hosts in teams before transferring them ( #2383 )
...
* Delete policies for hosts in teams before transferring them
* Add missing error check
2021-10-05 15:48:26 -03:00
Zach Wasserman
a2e9b539a1
Optimize policy_updated_at migration ( #2362 )
...
- Use `TRUNCATE TABLE` rather than `DELETE FROM` for improved performance.
- Move DDL statement after truncate to avoid issues with retries (due to
column already being created).
#2360
2021-10-05 09:24:03 -07:00
Tomas Touceda
2df4389aa0
Ignore empty host users or software inventory ( #2317 )
...
* Ignore empty host users or software inventory
* Only store additional if it's not nil
* Update label/policy updated at when we record the executions and skip saving host
* Update changes file
2021-10-01 18:27:57 -03:00
Tomas Touceda
d9f34b2c19
Issue 1840 bulk delete hosts ( #2268 )
...
* wp
* Add test by ids
* Add changes file
* Update docs and remove unneeded return values
* Address review comments
* Improve integration tests
* Use TearDownTest
2021-09-29 13:13:23 -03:00
Tomas Touceda
435178e93c
Add bundle identifier to software when available ( #2220 )
...
* Add bundle identifier to software when available
* Update docs
* Delete unneeded test
2021-09-28 18:13:34 -03:00
Tomas Touceda
2033d8208c
Add policy updated at ( #2246 )
...
* wip
* Add policy updated at interval and update the UI to use that
* Update rest api
* Fix tests
2021-09-27 16:27:38 -03:00
Tomas Touceda
d81a6317a0
Return host count when modifying a label ( #2221 )
2021-09-24 15:56:55 -03:00
Tomas Touceda
6497e0ba2e
Improve performance of cascade host software migration ( #2163 )
2021-09-21 16:37:13 -03:00
Tomas Touceda
1f324339f8
Add jitter to intervals ( #2158 )
...
* Add max jitter percent config
* Fix jitter calc
* Remove comment
* Reduce test jitter to make tests less flaky
* Remove jitter entirely
* Document new config
* Fix doc link
2021-09-21 14:21:44 -03:00
Tomas Touceda
4650484960
Remove fk label membership ( #2157 )
...
* Remove fk from label membership
* Add changes file
* Fix tests
* No need to IGNORE anymore
2021-09-21 11:48:20 -03:00
Martin Angers
86dce785ae
Improve performance of the Go test suite ( #2060 )
...
Closes #1805
2021-09-20 14:09:38 -04:00
Lucas Manuel Rodriguez
c69937945a
Introduce entityName type for mysql entity table names ( #2139 )
...
* Introduce entity type to specify mysql table names for deleteEntit* functions
* Remove changes entry for issue (non-user facing changes)
2021-09-20 14:47:06 -03:00
Tomas Touceda
b32b441c12
Issue 1512 filter observer can run queries ( #2110 )
...
* wip
* Filter queries for observers
* Update e2e test now that we filter queries
2021-09-20 13:07:51 -03:00
Tomas Touceda
baa42d367e
Add team policies ( #2103 )
...
* Add team policies
* Add team policy documentation
* Add changes file
* Update titles
* Fix lint
* Rewrite TeamAuthorize for more clarify
* Explicitly use two slices for clarity
* Simplify switch
2021-09-20 11:00:57 -03:00
Tomas Touceda
bdae8d04a2
Skip saving host users and inventory if disabled ( #2127 )
2021-09-18 11:33:36 -03:00
