Mar 09, 2024
1968 words
Booting LineageOS(Finally)

I've failed countless times while experimenting with different phones and operating systems. Unlike computers, which have a universal architecture, each phone possesses its unique structure. This makes installing operating systems on them exceedingly challenging. Furthermore,

Mar 05, 2024
1036 words
Invisalign Treatment

My front teeth have always been a bit uneven-the upper 2 middle teeth are crowded. Although it didn't cause any pain and I could eat normally, my mom always advised me to get orthodontic treatment

Nov 29, 2023
452 words
Offline RL

Note: All Yaml files are in the git repo: https://github.com/jimchen2/cs285-reinforcement-learning python cs285/scripts/run_hw5_explore.py \ python cs285/scripts/run_hw5_explore.py \ python cs285/scripts/run_hw5_explore.py \ The Random Network Distillation algorithm encourages exploration by training another neural network to approximate the output

Nov 24, 2023
521 words
Q Learning and SAC

Compute Action and use epsilon greedy action = torch.tensor(random.randint(0, self.num_actions - 1)) action = self.critic(observation).argmax(dim=1) Step environment Add data to replay buffer replay_buffer.insert(...) Sample from replay buffer batch = replay_buffer.sample(config["batch_size"]) Train agent, we update the

Nov 20, 2023
872 words
Policy Gradients

There are 2 kinds of estimator for Policy Gradients, full trajectory and and "reward-to-go" We run the two configs on Cartpole with different parameters, specifically, rtg means reward to go, na means normalizing the advantages.

Nov 18, 2023
371 words
Imitation Learning with DAgger

We run imitation learning and Dagger based on expert policies. In this experiment the expert policy is directly sampled out from a trained Neural Network, so Dagger differs from real world applications in that it

Visiting-Ocean-BeachVisiting-Ocean-Beach
Oct 27, 2023
679 words
Visiting Ocean Beach

Today I visited Ocean Beach. I was in a very bad mood and distorted these days. I couldn't get any work done and think about living in remote, isolated regions. I hopped on a Bart

Oct 23, 2023
430 words
Visiting Concord

Today I went to Concord, not the Concord near Boston where I had been to in the summer of 2016, but the one at the north of the Bay area. It was a warm radiant

Oct 21, 2023
864 words
Setting Up Raspberry Pi OS

Setting up and configuring Raspberry Pi OS can be a streamlined process by using chroot on a different machine. This guide will walk through the steps to prepare your Raspberry Pi SD card on a

Oct 14, 2023
584 words
Grub Bootloader and LFS

So grub is basically a bootloader to start the system. The point here is I've been using grub for almost a year now without a deep understanding. Grub boots the system by using grub shell.