Code

Threat detection#1783

Code

Draft

ag060 wants to merge 67 commits intomasterakto-api-security/akto:masterfrom threat-detection-v1akto-api-security/akto:threat-detection-v1Copy head branch name to clipboard

+6,721-2,770

Commits

Commits on Dec 23, 2024

• pushing malicious requests to kafka

  ag060

  committed
  b07151a

• added flush kafka messages task

  ag060

  committed
  1151e88

• added window based aggregation support for malicious requests

  ag060

  committed
  4550ea3

• using separate mongo for storing suspect data

  ag060

  committed
  731d25e

• fixed kafka host

  ag060

  committed
  6de974d

• fixed source ip generation logic

  ag060

  committed
  6660653

• not syncing writes and read for RedisWriteBackCache at the same time

  ag060

  committed
  5d21d82

• using redis backed increment counter cache

  ag060

  committed
  534ad26

• added group id to aggregate notifier

  ag060

  committed
  44362c9

• added notification cooldown support

  ag060

  committed
  df11b6a

• added start and end bucket ids with each detected alerts

  ag060

  committed
  8a344d3

• added ttl for redis entries

  ag060

  committed
  3862ca1

• added new collections for sample malicious requests and detected alerts

  ag060

  committed
  d1f0f9a

• addded cleanup sample malicious records task

  ag060

  committed
  f99611d

• refactor code

  ag060

  committed
  a203173

• refactor code

  ag060

  committed
  fb9bc69

• refactor code

  ag060

  committed
  d4219c2

• add aggregation parse layer

  

  ayushaga14

  authored and

  ag060

  committed
  491cddb

• grpc service for consuming malicious and smart events (#1748)

  Show description for 28bcd9a
  ag060

  committed
  28bcd9a

• apply aggregations

  

  ayushaga14

  authored and

  ag060

  committed
  cc8c31f

• removed db service and using mongo client everywhere

  ag060

  committed
  bf81ce2

• moved clean up task to threat protection service

  ag060

  committed
  740413e

• added authorization interceptor for grpc server

  ag060

  committed
  e19b55e

• removed account_id field from consume event service requests (threat-detection-backend)

  Show description for 8562788
  ag060

  committed
  8562788

• added client side authentication support while saving malicious and smart events

  ag060

  committed
  3abaa08

• added new api threat detection

  Show description for 99a0675
  ag060

  committed
  99a0675

• saving malicious sample data to postgres db

  ag060

  committed
  68a4e24

• abstracted out common kafka polling consumer task

  ag060

  committed
  f7cd995

• added tasks for sending alerts to protection backend

  ag060

  committed
  ad5b13b

• exposing single rpc method for recording alerts

  ag060

  committed
  bc83b53

• updated proto definition

  ag060

  committed
  e265de2

• removed cleanup task from threat protection backend module

  ag060

  committed
  8ae9eed

• updated kafka topic names

  ag060

  committed
  15f04fd

• running flyway migrations programatically

  ag060

  committed
  2382b2d

• refactored code

  ag060

  committed
  2438ea6

• added clean up for deleting all the malicious entries older than 7 days

  ag060

  committed
  d3704b7

• added hibernate orm (#1786)

  ag060

  committed
  89fec06

• threat protection producer consumer db writes

  

  ayushaga14

  authored and

  ag060

  committed
  3a90345

• added proto generation to ci

  ag060

  committed
  4d3e463

• fix create mongo client params

  

  ayushaga14

  authored and

  ag060

  committed
  8616f46

• deleted generated proto files

  ag060

  committed
  95f09f0

• added dashboard rpc service (#1808)

  ag060

  committed
  861835c

• updated proto definition to include malicious event type (SINGLE or AGGREGATED)

  ag060

  committed
  74bafd6

• storing api_collection_id in postgres

  ag060

  committed
  80b04e1

• fixed paths in ci for threat-detection module

  ag060

  committed
  2fe1e23

• moved kafka config from threat detection to utils

  ag060

  committed
  a1e8b76

• moved consumer and producer on same machine for threat protection backend

  ag060

  committed
  d1595ca

• refactored dashboard proto messages

  ag060

  committed
  7bd52a6

• added check if buf is installed in proto-gen script

  ag060

  committed
  9f3cb08

• fixed MaliciousEventModel not populating data from mongo

  ag060

  committed
  c5f627b

• refactored code

  ag060

  committed
  5daab8d

• disabled debug logging for hibernate

  ag060

  committed
  f4ced15

• removed unused imports

  ag060

  committed
  8d45294

• disabled debug logging for hibernate

  ag060

  committed
  36b9995

• committing kafka offsets manually now

  ag060

  committed
  9c1c757

• renamed threat detection backend service

  ag060

  committed
  8806577

• added health check server

  ag060

  committed
  7d3b407

• building threat detection backend image in staging workflow

  ag060

  committed
  b506fe4

• refactored generated proto files

  ag060

  committed
  cfe9b1b

• added health check for rpc and enabled reflection

  ag060

  committed
  3ae54be

• added health service for grpc

  ag060

  committed
  e30f66c

• using vertx http server as threat detection backend (#1842)

  ag060

  committed
  43c3912

• reading akto threat detection backend url from env

  ag060

  committed
  9264881

• added try catch

  ag060

  committed
  b46e067

• fixed sample not being to backend

  ag060

  committed
  b5e9675

• clearing cache as soon the alert is raised

  ag060

  committed
  e273f0b

• sending sample malicious events to backend only once

  ag060

  committed
  f640fdd