Commit Graph

3033 Commits

Author SHA1 Message Date
Zachary Wasserman
79818c72ab Add newlines in firehose records (#2166) 2016-06-14 16:50:28 -07:00
Gary
5eee608f62 Fixed bash griefing over postifx-compatible conditional compounds (#2159) 2016-06-10 16:37:56 -07:00
Nick Anderson
cf30388705 Moved test_utils to it's own directory out of core. Updated references (#2154) 2016-06-09 10:49:26 -07:00
Teddy Reed
866ff13fc3 Fix OS X kernel extension autoload (#2151) 2016-06-08 11:14:36 -07:00
Teddy Reed
63db493e4f Update AWS-SDK build to 0.12.5 (#2148) 2016-06-07 19:04:22 -07:00
Ryan Holeman
deb9c56633 Changed stream validation from list streams to describe streams (#2141) 2016-06-07 17:17:15 -07:00
Teddy Reed
78c8e8eca9 Minor cleanups to extension autoloading (#2147) 2016-06-07 17:14:17 -07:00
Teddy Reed
91b34010df Allow table specs to use multiple row indexes (#2146) 2016-06-07 17:13:48 -07:00
Ryan Holeman
5dd2a54f39 Ability to add default configs and postinstall scripts to deb/rpm packages (#2142) 2016-06-07 15:09:08 -07:00
Zachary Wasserman
462cd8bdbf Update AWS logger code for AWS SDK 0.12.4 (#2140)
The AWS SDK changed how custom HTTP clients are used, and this commit brings
compatibility with the new initialization style.
2016-06-07 15:06:49 -07:00
yying
9879733867 Filesystem Abstractions - Integrations (#2128)
* Integrated filesystem operation abstraction code into filesystem.cpp
* Modified filesystem unit tests to be more platform agnostic
* Added append mode for PlatformFile
* Minor bug fixes in filesystem operations
2016-06-07 14:08:50 -07:00
Teddy Reed
a8d6bc7c58 Use self-process for query join tests (#2144) 2016-06-07 13:01:07 -07:00
Nick Anderson
5d072cd080 Added except for lsb_release not existing on system (#2143)
Added an exception case for OSError when the lsb_release command isn't found on hosts.
2016-06-07 12:52:51 -07:00
Zachary Wasserman
0ec094c27c Update version for AWS SDK 0.12.4 (#2139) 2016-06-06 16:43:01 -07:00
Teddy Reed
763f4e9437 Use SQLite 3.14.0 to support LIKE and EQUALS (#2137)
This commit bumps the third-party SQLite to the 3.14.0 pre-release (18:59).
With 3.14.0 the LIKE and EQUALS constraint operators may be mixed within a
query. Previously these would fail to produce a valid set.

As part of the support, each virtual table should choose to bypass rowid-based
deduplication using the new "WITHOUT ROWID" create table epilog. This will
be appended to the schema if the table defines a PRIMARY KEY using index=True.
2016-06-06 09:36:53 -07:00
Teddy Reed
e0f350e439 Limit SMBIOS reads to 0x000f0000-0x00100000 (#2135) 2016-06-05 13:09:03 -07:00
Teddy Reed
597c7d5c02 Add systemd service to Xenial (#2134) 2016-06-03 09:09:09 -07:00
Teddy Reed
af1a8d8ad6 Check for none in linked_keg (#2133) 2016-06-02 16:10:26 -07:00
Nick Anderson
240958ea76 Fixed typing in FileOps tests (#2127)
Some of the types in fileops tests were causing warnings to be thrown
during build, due to type mismatch. I've added a few local variables to
quiet these warnings.
2016-06-02 15:46:55 -07:00
Teddy Reed
4704ccd6c9 Use local AWS-SDK formula for OS X (#2132)
Thus begins our need to include local (modified) brew formulas.
This commit adds a new provision library method: local_brew. Use this function
within provision scripts to install packages that are not appropriate for
homebrew-core.
2016-06-02 14:58:43 -07:00
Javier Marcos
152602dfdd Adding sip_config table to it-compliance pack (#2131) 2016-06-02 12:22:59 -07:00
Teddy Reed
0beb7efef7 Add process auditing and a SQL intro doc (#2129) 2016-06-01 17:28:51 -07:00
Justin Gerace
d27930b4ea Fix Scientific Linux build process (#2130) 2016-06-01 16:59:55 -07:00
yying
5f81cd9e2b Filesystem Abstractions - Code and Unit Tests (#2119)
* Implemented filesystem operations abstraction code
* Added filesystem operations abstraction unit tests
* Modified CMake configurations to support the building of the abstraction code and unit tests
2016-05-31 12:20:38 -07:00
Nick Anderson
3422100578 Updated the get_platform.py script to be Python 3 compatible (#2122)
Added in future imports to make the script forwards compatible and updated print functions.
2016-05-31 09:10:53 -07:00
Teddy Reed
de8ef7b627 Update README/wiki for Ubuntu 16.04 (#2126) 2016-05-30 21:17:03 -07:00
Teddy Reed
05882d717c Add basic string split and inet_aton functions (#2124)
The three new SQLite functions:
- split: Splits a column using a set of tokens and a selected index.
- regex_split: Similar to split but with a regex instead of tokens.
- inet_aton: Returns the IPv4 decimal value for a string-formatted address.
2016-05-29 02:06:02 -07:00
Teddy Reed
1cf80c9300 Fix os_version detection for Ubuntu 16.04 (#2125) 2016-05-28 20:02:58 -07:00
Teddy Reed
37544138b5 Add basic math extension functions (#2123) 2016-05-28 17:46:24 -07:00
Yonas Yanfa
d08e55545a Update index.md to mention support for FreeBSD. (#2118) 2016-05-27 14:01:54 -07:00
Teddy Reed
a9ed73c68d Add removeService to Dispatcher API (#2116)
With a removeService method, combined with the abstracted thread start in
the Dispatcher API, services auto-remove when finished.

This will un-break the kernel communication tests. These tests only stop
when all their producer threads/services have ended.

This also promotes the OS X kernel build to 10.11.
2016-05-27 11:17:06 -07:00
Teddy Reed
10664a4945 Add --ephemeral for daemons and disable shell events (#2111)
This changes several initialization steps:
- The daemon (and shell, though not needed) have a new --ephemeral flag.
- Events are now disabled in the shell by default, use --nodisable_events to
  re-enable.
- RocksDB-based backing storage is now disabled in the shell by default.

The --ephemeral flag for the daemon is disabled by default and will allow
skipping configuration and database path sanity, and skipping pidfile checks.
This is intended to be used when debugging or monitoring the daemon process.

To make the RocksDB backing storage feature usage very clear we introduce a new
flag: --disable_database. The shell sets this to true unless overridden in
a flagfile or via command line arguments.
2016-05-20 08:39:04 -07:00
Teddy Reed
a5100f7b12 Disable Google Benchmark and AWS SDK from build (#2113)
See: #2112 and #2107
2016-05-19 17:23:07 -07:00
Teddy Reed
9d53a1c148 Rename time and environment columns for process_events (#2096) 2016-05-19 14:41:03 -07:00
Sharvil Shah
8b0e6e138f Fix benchmark target and bump version of google-benchmark to 1.0.0 (#2065) 2016-05-19 11:56:54 -07:00
Teddy Reed
c4acfe89e5 Introduce table aliases (#2104) 2016-05-19 09:40:43 -07:00
Teddy Reed
df7003e708 Use ruby/gem ABI version 1.9.1 on 12.04 (#2106) 2016-05-18 22:21:06 -07:00
Teddy Reed
869993b543 Fix Ubuntu 15.04 build (#2105) 2016-05-18 20:48:26 -07:00
Teddy Reed
b28c4d8d0f Introduce table options (#2101)
Table options includes a change to the Registry::call API for TablePlugins.
When requesting route information or the 'columns' action, a new 'op' key is included.
2016-05-18 12:23:52 -07:00
Ryan Holeman
e29ad573ef fixed issue with aws logger example for kinesis and firehose (#2102) 2016-05-18 09:21:32 -07:00
Teddy Reed
50694052c4 Use POST for distributed queries within the node API (#2103) 2016-05-18 09:20:17 -07:00
yying
26ad131c38 Building osquery unit tests on Windows 10 (#2100)
Integrated process abstraction code into more locations
Defined new macros for abstracting across various platforms
Added GLOG_NO_ABBREVIATED_SEVERITIES for glog to support Windows
Fixed some minor CMake issues involving thrift
Updated gflags package; reflecting change in provision script
Preparing CMake config files for WIN32 support
2016-05-17 12:39:11 -07:00
Teddy Reed
9c01d4a6e3 Add quicklook_cache to Darwin (#2099) 2016-05-13 23:49:10 -07:00
Teddy Reed
77273f6500 Add logEvent API to logger plugins (#2088) 2016-05-13 19:48:40 -07:00
Teddy Reed
314e3467bc Check for systemd service in osqueryctl (#2090) 2016-05-13 19:48:22 -07:00
yying
15d1455957 Process Operations - osquery/core Integration (#2087)
This integrates the process abstraction operations within osquery core.
2016-05-13 19:47:45 -07:00
Marcin Wielgoszewski
484cf9c919 Add blurb about doorman (#2094) 2016-05-12 15:37:22 -07:00
Teddy Reed
0ffe0c9d16 Add --pack flag to the shell (#2093)
This introduces a new testing-related flag to the osqueryi shell.
The --pack flag takes a single argument, the name of a configured pack.

To list the configured packs try:
$ osqueryi -A osquery_packs

To run all queries, immediately and serially, try:
$ osqueryi --pack NAME_OF_PACK
2016-05-12 09:22:05 -07:00
Teddy Reed
e61116f5db Add Ubuntu Xenial 16.04 build support (#2089)
The current Ubuntu-provided Xenial does not mount a shared folder.
2016-05-12 08:47:05 -07:00
Christian McHugh
1f4d4f6965 - Install CMake on all Debian versions- Only install Ruby 1.8's development package on Wheeze
- Install CMake on all Debian versions
- Only install Ruby 1.8's development package on Wheezy
2016-05-12 08:45:33 -07:00