python cs285/scripts/run_hw4.py -cfg experiments/mpc/halfcheetah_0_iter_layer_1_size_32.yaml python cs285/scripts/run_hw4.py -cfg experiments/mpc/halfcheetah_0_iter_layer_1_size_16.yaml python cs285/scripts/run_hw4.py -cfg experiments/mpc/halfcheetah_0_iter_layer_2_size_16.yaml Get predictions pred_obs_deltas_normalized = self.dynamics_modelsi pred_obs_deltas = pred_obs_deltas_normalized * self.obs_delta_std + self.obs_delta_mean pred_next_obs = obs + pred_obs_deltas ``` Action Selection rewards = np.array([

The key idea is that Cloudflare R2 has low storage fees(10 dollar per TB per month), and no egress fees. Egress fees are scary when I consume videos like this, say, AWS or GCP's egress

Regarding the Educoder platform mentioned before, the platform is very problematic. It doesn't have any CSP policies, you can input markdown to it, and I discovered this when it rendered images directly from my CDN

Basically there are 3 kinds of browsers left, like the dominant one is Chromium based browsers(which is integrated into Electron apps), then there is firefox, then there is WebKit-based(webkitgtk) based like Safari or Gnome Epiphany

Today I finally decided to go out, despite the heat. So basically I hopped on bus 91 and here I am in Clearwater bay but it's a pretty good place There is a beautiful beach

AWS published a machine learning blog about how you can finetune Claude 3 Haiku on the Bedrock really easily, and it got me very interested and wanted to set up Haiku to imitate me. Specifically

So following the horrible semester end, came a horrible start of summer. I was gonna join the HKUST research program, but it started very wrong. So I didn't get an exit endorsement for study, or

So anyways, long story short, I started learning and after 3 weeks my new website was born. It just displayed my blogs and visitinfos and a message box. So the problem with frontend+backend+database, where your

So the files are not available in China, just download and upload them to a S3 bucket (hopefully available in China), then change the urls in the installing script(alx.sh file and installer json file) MacBook

After getting rid of the crappy UI and installing LineageOS on my Redmi Phone, I was still not satisfied. Mainly because I am using WeChat too frequently, and it is kinda addictive and time-wasting. Those