These are completed projects from leading clients in Silicon Valley, Maryland, Washington D.C, Virginia, Massachusetts, Texas, Los Angeles, San Francisco:
https://github.com/orgs/serenaconsulting/repositories
MIT Lincoln Labs, Hanscom AirForceBase, Lexington, MA
SCRUM MASTER - DevSecOps
- Java Springboot Maven, Gradle microservices
- C/C++, cmake, clang-tidy, clang-format
- Jenkins, Atlassian – Bamboo, Git, Bitbucket
- LAMP – Linux, python, sqlite, Flask, elasticsearch
- JADC2
US Navy, Dahlgren Naval Base, Virginia
- Build/Release Automation and Deployment of MK160 Gun Control System
- Build Modules for Missile Defense System with Visual Studio, C/C++, Python3, and Java
- Automate deployment of releases via Satellite
- Atlassian Toolset Administration – JIRA, Confluence, bitbucket,
- Automated Deployment - docker, Openshift, gitlab, sonarqube, jfrog artifactory
- CI/CD pipeline – build/release, gradle, java, ant, maven, squish automated testing, Openstack
Defense Intelligence Agency, Washington D.C.
DevOps, CI/CD
- Build/Release Automation and Deployment of NSMT, Chronicle, Nodejs Apps, with Jenkins, Docker,
Openshift
- X-Ray and Prisma Scans for ci/cd pipeline via Jenkinsfile, python scripts, ruby scripts, groovy
- Greymatter, and Helm Charts for nodejs apps
- Atlassian Toolset Administration – JIRA, Confluence, gitlab
- Automated Deployment - docker, Openshift, gitlab, sonarqube, jfrog artifactory with Dicelab
- CI/CD pipeline – build/release, gradle, java, ant, maven, docker
- DoD Security clearance and DoD Interim TS Clearance
--------------------------------------
Zenimax, Bethesda.net - Bethesda, MD
Build and Release Engineer,
Android/iOS/Playstation/Xbox/Nintendo
- Groovy Scripting – Jenkinsfile Automation, Jenkins build/release ci/cd pipeline , Jenkins plugins
- Mobile Device = Build and release engineer for iOS, Android builds
- Setup and configure iOS SDK and Android SDK on build nodes and testbeds
- Setup and configure Windows machines for Playstation, Nintendo and XBOx testing
- Jenkins pipelines and automated build environment for iOS and Android
---------------------------------------------
Innovative IT, Department of Homeland Security 2020
Kafka DevOps, AWS Cloud DevOps, Java Development
- AWS Lambda Function, AWS S3, AWS EC2, AWS RDS, AWS SQS, AWS Serverless deployment
- Kafka Security, Kafka encryption = configure encryption on kafka topics
- Java Builds, gradle , maven = build/release engineering with maven and gradle
- Postgres, database administration, sql scripts
- Microservices = deploy microservices in OCP
- Apigee = configure apiproxies for microservices and apikeys, configure deployment of REST api
proxies
- OCP deployment and administration, Ansible, Jenkinsfile, Groovy
- Test Automation : JMeter, Junit, Jacoco, Smoke Test, Performance Test automation
-------------------------------
Dick’s Sporting Goods
Tech Lead – Kafka Architecture (contractor)
Pittsburgh, PA
- Perform Kafka Cluster Assessment of DSG Kafka infrastructure
- From Gap Analysis – conduct Architecture Reviews with each dev team, and discuss with Confluent
- Assess Kafka monitoring, automation/containerization, Failover/Disaster Recovery, and development
- Meet with Architect and review infrastructure and make recommendations
- Work with L2 support and Migrate from GCP to Azure environment
- Setup Failover and DR with Replicator for each connector
- Kafka Grafana dashboards, Kibana logging, Instana, PromAlerts, PromQL, Prometheus/Alertmanager
- Confluent C3, Confluent Replicator, KSQLDB, Kafka Streams, Rocks DB, Cosmos DB, Postgres, Schema Registry, AVRO, HA
Proxy
------------------------------
Instaclustr
KafkaAdmin And Monitoring
- Create kafka topics, perform replication – ensure replication of schema registry and topics
- Automate deployment of kafka
- Administer, monitor kafka with Elasticsearch and confluent control center for performance and kafka related
stats
- AWS , Docker, Monitoring, Cloud Admin, Ansible, Terraform
- Bash and python scripts for monitoring, alerting, Nagios check_mk, Kafka, and OpenStack
services
- Adding inventory and decommissioning C-Series and B-Series servers in OpenStack Service
Cloud
- Installing service assurance client to management nodes, nova nodes, and puppet master for
monitoring
- Environment: Python, OpenStack, Ceph Storage, SolidFire NetApp Storage API, RESTApi, Ansible, Nagios, check_mk, Elasticsearch, Kibana, Logstash,
Grafana, collectd
- AWS Cloud deployment and monitoring, Ansible
Google Cloud Services, 2019, MountainView, CA
- gcloud docker, gcloud container kubectl api for deployment , GCP CLI (https://cloud.google.com/sdk/gcloud/reference/container/clusters/create)
- Cloud Services and Cloud Operations, Kuberneter, GCP, Google Cloud SDK
- Cloud Automation, Google Cloud Deployments and CI/CD
- Firebase CLI , ReST API, Node.js, javascript and python scripting to access production
- Firebase Database , gcloud API, compute engine, Google Cloud TPUs, kubernetes and docker
APPLE (www. apple.com) , 2016
Union Bank , 2017
client = MUFG UnionBank of Los Angeles
- Test vocera Servers, SIP Telephony Gateways, Client Gateways, jetty server
- Test Automation for : Web Services, SOA, Jetty Server
- SAN Certification Test Plan, API Tests for Call Processing with CUCM
- Test Devices for connectivity : Android Devices, iPhone, Cisco IP Phone, Motorola
phone, smartphones, Samsung Galaxy
- Test Vocera Collaboration Suite, Vocera Connect apps downloaded from Google
PlayStore and iOS App Store
- Installer testing , SSL Testing , Upgrade with Windows 2003, 2008, 2012
- Nuance Vocalizer Text-to-speech
Environment:
CUCM, IP Call Routing, SIP Telephony Gateway, Nuance Vocalizer, Mobile Devices, Android devices, iOS devices,
VOIP Features, Voice-Over-IP Protocols and Stack, java, Jetty, WebServices
Intuitive Surgical, Surgical Robot
AWS Helpful Links, FYI:
- https://medium.com/netflix-techblog/zuul-2-the-netflix-journey-to-asynchronous-non-blocking-systems-45947377fb5c
- https://forums.aws.amazon.com/thread.jspa?threadID=114646
- https://forums.aws.amazon.com/thread.jspa?threadID=234535
- http://docs.aws.amazon.com/AmazonCloudFront/latest/DeveloperGuide/RequestAndResponseBehaviorCustomOrigin.html
- https://stackoverflow.com/questions/12498704/cached-non-cors-response-conflicts-with-new-cors-request
- http://docs.aws.amazon.com/AmazonS3/latest/dev/cors.html
Instaclustr
KAFKA MONITORING NOTES
Q: What is HTTP Event Collector?
The Splunk HTTP Event collector is really pretty straight forward and you can find a lot of documentation online that would explain how it works much better than I
can. It’s just an alternate way of getting data into Splunk rather than the usual means (forwarder). It’s basically just a listener that accepts raw or JSON data and sends it along to an
index.
BACKGROUND
- What is kafka-splunk-connect?
Splunk Connect for Kafka is a Kafka Connect Sink for Splunk with the following features:
- How do we install it ?
https://github.com/splunk/kafka-connect-splunk
For Installation, we Need access to :
- Kafka hosts that need to be monitored
- SPLUNK DEV-STL instance access
connect-distributed.properties
file
bootstrap.servers
and plugin.path
- which is available for download
INFRASTRUCTURE
Q: Which SPLUNK instance is used for monitoring ?
access to any data for this POC will be through the MSE dev instance:
Q: What do we set values for “bootstrap.servers” and “plugin.path” in connect-distributed.properties file?
bootstrap.servers
= kafka broker
plugin.path =
install directory of your Kafka Connect Sink and Source Connectors = place the jar file here for
installation
Q: Where do we install the connector jar ?
the jar needs to be installed and configured on the Kafka host(s) per the instructions on Splunk/Github
Place the jar under “plugin.path” directory
Q: How do we start the connector?
.$KAFKA_HOME/bin/connect-distributed.sh
$KAFKA_HOME/config/connect-distributed.properties
Q: How do we create connector task?
Run the following curl command
for host = nc3-001b-ixb-sp and port = 8088 and below token
curl
localhost:8083/connectors -X POST -H "Content-Type: application/json" -d '{
"name": "kafka-connect-splunk",
"config": {
"connector.class": "com.splunk.kafka.connect.SplunkSinkConnector",
"tasks.max": "3",
"splunk.indexes": "kafka",
"topics":"Kafka Control Metrics Reporter",
"splunk.hec.uri": "xxxxxx:8088",
"splunk.hec.token": "ff7810ff-7cd2-4756-876b-58bc119b3286"
}
}'