Repository navigation
Slow Eventgen, set the host in Eventgen, stop installing the CIM app (SA-S4R 2.0.1) - #45
Merged
Merged
Conversation
…(SA-S4R 2.0.1) Eventgen: each stanza now emits its batch every 10 s instead of every 1 s, so the baseline is about 300 events/min (was ~3,000) and the attack stream adds about 150 events/min (was ~1,500). Batch sizes are unchanged, so the product/cart ratio and the attack-to-baseline ratio stay the same. Host: the shop host is set in eventgen.conf [global] and inherited by every sample stanza. This replaces the index-time host transform from #38, which was built on a wrong conclusion: the earlier "Eventgen ignores host" test copied the file into the running app without reloading Eventgen's config in splunkd, so the old value kept being used. With the reload, host works per stanza and from [global]. The transform, its props stanzas and the claim in the docs are gone, and a host change no longer needs a Splunk restart. The docs now say that a hand-edited eventgen.conf needs POST .../conf-eventgen/_reload. CIM: compose.yml no longer installs the Splunk CIM app (Splunkbase 1621), which the workshop does not need. SA-S4R keeps what makes the data CIM-compliant: the CIM Web field names and aliases, the s4r_web_access eventtype with its web tag, and the default.meta exports. tests/s4r-cim-web.sh fails if the Splunkbase pin comes back. Version: neither the rate nor the host adds an interface, so SA-S4R goes 2.0.0 -> 2.0.1. Checked live: after a conf reload and a modinput restart the rate is ~55 events per 10 s; with the old transform unloaded the events still carry host=www.buttercupenterprises.com from Eventgen alone; with the CIM app disabled and so1 restarted, the S4R tools, the host and tag, the CIM-named fields and the tool policies all still work. Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
3 tasks done
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
What
Three changes to the S4R stack, in one commit.
1. Eventgen at about 300 events/min
2. The host is set in Eventgen
host = www.buttercupenterprises.comis set ineventgen.conf[global]and inherited by every sample stanza. This replaces the index-time host transform from Make SA-S4R access_combined data CIM Web ready #38.hostsetting copied the file into the running app without reloading Eventgen's config in splunkd, so the old value kept being used and I wrongly concluded that Eventgen ignoreshost. With the reload it works, per stanza and from[global]. The transform, its props stanzas and the wrong claim in the docs are removed, and changing the host no longer needs a Splunk restart.eventgen.confon a running stack needsPOST …/configs/conf-eventgen/_reload, then a disable and enable of the modinput.3. The CIM app is no longer installed
compose.yml, the pin table, the app lists and the specs drop Splunkbase 1621, which the workshop doesn't need.s4r_web_accesseventtype with itswebtag, and the exports stay. Anyone who installs the CIM app still gets a workingWebmodel on this data. The docs say the stack doesn't install it.tests/s4r-cim-web.shnow fails if the Splunkbase pin comes back.Version: SA-S4R goes 2.0.0 to 2.0.1. The rate and the host add no new interface, so it is a patch.
(An earlier version of this branch also added a small data model. I dropped it as out of scope for the workshop, and none of it is in this diff.)
Testing
On the running stack:
host=www.buttercupenterprises.comfrom Eventgen alone.hostworks per stanza and inherited from[global], checked with a throwaway stanza writing to the emptysummaryindex.so1restarted: theWebmodel is gone, and the S4R tools, the host and tag, the CIM-named fields, the tool policies,make statusandmake verify-mcp-remoteall still work.tests/s4r-cim-web.shthree ways (host removed, transform back, CIM pin back) and each one fails.make check-splunkbase-pins, 384 relative Markdown links resolve,pre-commit run --all-files,make testAfter merge:
package-s4r.ymlpublishes 2.0.1 aslatest. A new stack gets it, and no longer gets the CIM app, aftermake clean-y && make up. I have not run that fresh boot, because the packaged app only exists after merge.🤖 Generated with Claude Code