citizenhicks

ai enthusiast

X/Twitter

About Me

indie ml researcher and ai enthusiast with a passion for developing innovative solutions. experienced in large language models and reinforcement learning. focusing on creating impactful and scalable applications.

Python TensorFlow PyTorch MLX Swift SwiftUI JavaScript LLM Reinforcement Learning Probability theory

Projects

pegasus

Pegasus is an AI-driven financial analysis platform designed to streamline document ingestion and reporting. It leverages large language models (LLMs) for both text and multimodal (vision) tasks, enabling complex PDF ingestion, chunk-wise summaries, and robust interactive chat features.

GitHub Repository

Entropix

Closely following and contributing to the Entropix project.

GitHub Repository

GRAPES: Graph-based Reasoning and Planning with Ensemble Systems

An innovative approach to enhance language model reasoning using Monte Carlo Tree Search.

  • Tech Stack: Python, asyncio, Pydantic
  • Achievement: Improved accuracy from 62.50% to 78.12% on complex reasoning tasks
GitHub Repository

TD3-HER for Robotic Control

Implementation of Twin Delayed Deep Deterministic Policy Gradient with Hindsight Experience Replay for sparse reward environments.

  • Tech Stack: Python, TensorFlow, Gymnasium, Panda-Gym
  • Features: Sparse reward learning, Hindsight Experience Replay, Twin Delayed DDPG
GitHub Repository

CyberSweat (also known as workout.AI)

CyberSweat, the ultimate fitness companion for your workouts! Our app uses GPT3.5 to generate personalized workout plans for you, based on your goals and preferences. Whether you're looking to build muscle, lose weight, or improve your overall fitness, the CyberSweat has you covered. With a wide range of exercises to choose from, you can mix and match to create the perfect workout for your needs.

  • Tech Stack: Swift, SwiftUI, Firebase, OpenAI
  • Features: One of the first apps which used generative ai to create personalised workouts

closed sourcecode

Skills

Python PyTorch TensorFlow MLX Swift SwiftUI JavaScript Reinforcement Learning Graph Algorithms LLM iOS Development AWS Firebase Docker

GitHub Stats

GitHub Stats