A collection of my notable projects in AI, reinforcement learning, and open source development.
A comprehensive C++ raytracer built from scratch using only the standard library. Features include Blinn-Phong shading, shadows, reflections, refractions, textures, and tone mapping. Advanced features include BVH (Bounding Volume Hierarchy) for performance, antialiasing sampling, aperture sampling for depth of field, BRDF materials, area light sampling, and multi-bounce path tracing for photorealistic rendering.
Contributed to ViZDoom, a platform for AI research on the classic video game of Doom. Proposed & implemented the Python typing support, enabling IDEs to recognize & provide hinting for ViZDoom classes, functions, enums, etc. The tool for building Python type stubs programmically is made available as both a utility script and part of build process.
MSc thesis: Training Reinforcement Learning agents on Doom with Semantic Segmentation. This project uses novel heatmap analysis methods and iteratively trained two generation of RL agents by creating the Semantic Segmentation dataset with the best explorer agent statistically. Investigated the different charateristics of each input type (RGB, SS, SS+RGB).
Contributed to Stable Baselines3, a set of reliable implementations of Reinforcement Learning algorithms in PyTorch. Currently proposing to uniform buffer dtype decision logic and the overall interface of buffer classes.
Created sb3-extra-buffers, a library that adds compressed rollout/replay buffers to Stable Baselines3. Featured in the official SB3 documentation, it provides 90%+ memory savings for image-based observations using compression algorithms like ZStandard, gzip, LZ4, and RLE.
Maintained a Windows-friendly fork of the Standardized Project Gutenberg Corpus (SPGC) generation pipeline. Fixed numerous bugs including UTF-8 decoding errors, missing NLTK downloads, and bookshelves information fetching issues. Added parallelized text processing, Windows support with cwRsync, and additional customization options for corpus generation.