Tom 7 Radar

				x Other ways to read Tom 7 Radar: RSS feed for aggregator software

Entries from December 2021

p
e
r
s
o
n
a
l

HINEY 2@22 (31 Dec 2021 at 19:33)

"Hiney" of course being the proper pronunciation of "HNY," being the laziest way to wish someone a Happy New Year. Getting this post done "early" since with 20 years of experience I foresaw the trap where the ball would be falling (actually I don't care about that ball at all but it's serving a metonymic function here) and I would do that face from Sudden Clarity Clarence and invariably lose 1,000 points for lateness.

I did get a few things done this month, although unfortunately I can't actually post about them until they first appear in their proper venues. So in this short post I will only tell you about video games. I let myself get sucked into Cyberpunk 2077, which is GTA In The Future. The game got a lot of complaints at launch, but I think it's pretty good now; the main story has several great ideas and setpieces and the only bugs I've encountered is stuff like cars floating in the air or scripted sequences playing out with unexpected preconditions, both of which basically make the game more fun. Right away, I spotted my font Action Jackson in the game:

Action Jackson in Cyberpunk 2077. Here NC as in I ♥ Not Contacting Tom 7 when I use his font

I was excited when I found this in a corner of V's apartment, but it's actually EVERYWHERE in the game. You can probably find it in 90% of street corners, and one of the shittiest guns that you keep picking up has this sticker on it. So I keep getting distracted by it, and also of course now I'm hyper-aware of the graffiti since I would like to make another spotting of a rarer child, if possible. I actually think they did a great job with the graffiti in this game (in fact in general the art is very good) so it's fun to study, but there is SO MUCH of it and many red herrings.

OK, I have to go rejoin the HINEY "party" now! SIGBOVIK season is approaching so more to share soon. :)

(2 comments — almost 3 years ago) [ comment ]

Entries from November 2021

p
e
r
s
o
n
a
l

December -1 (30 Nov 2021 at 22:30)

Oops! November slipped through my fingers so I actually wrote this on December 1, and backdated it, one of the more egregious misses in my silly life-long pursuit/curse to fill every cell of the calendar at the bottom of radar.spacebar.org. -1,000,000 points!

At the beginning of the month it got cold and my heat immediately failed, as is traditional. It was challenging to get time from any professionals to come out to fix it this time (seems everyone is very busy and short-staffed), and due to multiple previous ceiling waters I am very nervous about my pipes freezing when the temperature drops, so I took matters into my own hands and fixed it myself. Fortunately the problem was basically entirely electrical (where I have some modest understanding): The power-stealing Nest thermostats had finally destroyed the transformer they had been DrACulizing for years, and "all I needed to do" was buy a new zone relay controller and rewire the 12 wires that were going to it, and run new common wires to the Nest thermostats so they could drink normal blood the safe way. Even though I would rather have not spent my own time and stress, it was gratifying to feel like I can do such a repair myself, rather than just slowly freezing to death or whatever normal people do when this happens and they can't find someone to come fix it (?). The other good news is that my homemade distributed temperature and humidity sensor network is getting ever stronger and ever more complicated as a result of increased anxiety here. One downside, though, is that I now realize that if I just redesigned and built my own zone relay controller, I could fix one moderately annoying persistent problem with the heat that was the original reason for the other complicated thing.

Speaking of the thing where I curse myself with my own home-grown technology, I continued hacking on this ML thing that I described in the previous post. The main thing was to work on performance, since otherwise you have to spend a lot of time waiting for it to do its thing while training. I made it several hundred times (!) faster for some smallish toy problems. There were several things I did, but the main thing was to provide OpenCL with more internal parallelism by also parallelizing the kernels over training examples rather than just the e.g. nodes. I had a TODO since the beginning to try this, but it took some delicate rewriting, so I'm not surprised I procrastinated it and glad it paid off. (It can be quite hard to know with GPU workloads. I'm still developing intuitions. Prior to this, the card was still showing "90% utilization"!) I also did a variety of more interesting / fun tricks, even poking at the PTX intermediate code for the first time. Mostly I was working on toy problems, like something that was trying to simultaneously learn a word embedding and use that to predict a missing word, like on this successful example:

✂ clip 'n save

input: [it has been (proposed) that a]

output: [it has been (said) that a]

Here the words "it" "has" "been" "that" "a" are provided as inputs, and must all be encoded with the same function to a 64-place vector. Then those vectors must be used with a simple network to predict the missing word's vector, and then each vector must be decoded the same way to a word. Here it decoded all the given words correctly (not hard, but it has to learn this task simultaneous with the harder one) and it predicts a reasonable guess for the missing word ("said" instead of "proposed"). Others have done much more impressive things with language but this was fun to see happen from scratch. Unfortunately if I let that run for several more days it will all of a sudden start diverging. The time series (of weights, gradient) looks like this, for example

Detonation

To the left, a sensible distribution of weights with some gentle snowdrifts, then all of a sudden it goes through a series of abrupt regime changes where the error gets super large. I still don't know if this is a bug or I just haven't prayed enough to the dark wizards of hyperparameter tuning, or what. Since I don't even care about the toy problems, I did move on to some of these audio applications I had in mind in the first place (which I do care about), but I'm also experiencing similar problems there. I'm sure I will try to debug once I get some energy back, or else keep rolling the dice until some magic happens.

A quick font sighting. I like this band Snail Mail (especially her album Lush) and took a screenshot of this upcoming concert in Pittsburgh so I guess I could feel bad about not going to it because it still seems a bit too much coronavirus for me. Just now flipping through my phone to look for pictures of my zone relay controller I saw it again, and I'm like yo wait is an ultra rare font sighting?

Snail Mail - Donner

It absolutely is my font Donner, which I made in A.D. 1997, two years before this indie rock prodigy was born! It of course is a terrible-looking font (I wrote, as a Freshman in college, "I would recommend this for headlines only, and it is somewhat difficult to read at small sizes.") although it makes sense for what they were going for here. I think I was thrown off on the first look by the fact that the repeated letters were edited (I appreciate this touch, even if it was intended to obfuscate font copyright!), but I'll also accept the shame for not recognizing one of my children immediately, even if it is one of the worst children. -1,000,000 points!

I finished up Metroid: Dread, which was fun. It has this map system where every pixel of the map remembers whether you've been there, and I can't help myself but catch 'em all. I can confirm that (a) there is no in-game acknowledgement that you are a completely bonkers map completionist and (b) you can't even do it because the escape sequence absolutely does not give you enough time to cover areas that are only accessible during that sequence. Maybe the speedrunning geniuses will figure out some trick. (Actually the speedruns for this game do not disappoint. My favorite trick is "axis skew", where you abuse some animation in order to make Samus face the screen (rather than left or right as would be normal in this "2D" game) so that she has plenty of space to charge up her hyper dash by running in place. See this breakdown for example.) Right now I am working on Garlic which is a precision platformer in the vein of Celeste. Not as magical as that game but it is pretty funny and the challenges are well-designed.

(4 comments — almost 3 years ago) [ comment ]

Entries from October 2021

p
e
r
s
o
n
a
l

Happy Halloween 2021! (31 Oct 2021 at 22:46)

This is the busiest time of year for me, and several weekends were filled up with activities. For example as mentioned in post 1197 we did a trail Ragnar race in New Jersey at the beginning of the month. I have done a few Ragnar-type races before (e.g. post 1162 or 1174), but only the kind where the team drives the course in a van and it covers several hundred real miles. With the trail style, you have a camp site where you stay the whole time, and all the running starts and ends near there, with team members all doing the same three routes. Since we had a last-minute dropout I ended up doing one of the loops twice in quick succession, even. The distance was mild but the terrain in this park (Wawayanda) was pretty bad, with tree roots and loose boulders everywhere. I got sick of hearing the word "technical." It was especially ankle-sprainy in the dark (since it runs continuously, everybody has at least one middle-of-the-night run with a headlamp) but I was somehow unscathed. I missed the component of actually covering a lot of ground, but it was nice to not be cramped in a smelly car so much. My 4th leg was noticeably easier than usual, perhaps because I was able to walk around and sleep reasonably to recover. We were helped by perfect weather and it was low on COVID, being pretty much entirely outdoors.

I did find a little time for projects. I'm still hacking on this custom ML package with some audio applications in mind, although I'm letting myself get distracted by some simple toy problems (e.g. word embeddings) since with those it's easier to understand whether it's working. One of the main things I did recently was to make it possible for layers to mix various configurations (e.g. a dense component and two convolutional components with different window sizes), which is basically straightforward but required me to gut the whole thing and deal with a lot of fiddly bits. (When I'm programming for fun I really do like problems where performance matters, and this is one of them!) Since I was having some disappointing results on these toy problems I tried adding some known techniques (e.g. adaptive per-feature learning rates), which helped. It helps even more to find bugs: Several times it was "kind of working but disappointing," but when I investigated there was actually some serious problem. (Example bug: I was zeroing only the first quarter of a vector because I forgot to multiply by sizeof (float). But it was still able to learn effectively with 3/4 of its brain damaged. Other bug: I separated a kernel into two passes, but then forgot to call the second pass. It was still able to learn something because the gradients were only wrong half the time, and only on earlier layers.) Fixing those bugs is even more satisfying than performance fiddling. Makes you kinda want to add bugs on purpose like little puzzles for yourself. But, nothing of interest to share from this endeavor yet; I'm mostly just staring at homemade visualizations like this:

This actually ends well, believe it or not

Video gaming: I finished Deathloop, which I definitely enjoyed, although it had several flaws and doesn't quite live up to its premise. Certainly it was no Outer Wilds! I also played through Axiom Verge 2, which was okay but not as good as the first, and had some serious problems (pretty much all the "boss" fights you could just brute force, at least if you had been collecting the fairly easy "secrets" as you played). It was a reasonable appetizer for Metroid: Dread, which I am playing now. The Alien: Isolation aspect is a good fit for this aging genre, I think.

Have a spoopy Halloween!

[ comment ]

Entries from September 2021

p
e
r
s
o
n
a
l

Number 42 (30 Sep 2021 at 22:41)

Couple things this month:

It was my birthday and I became 42 years old! I would have appreciated being this number of years a lot more when I was 17 (but that's literally impossible), though it still has some minor specialness. When I started this blog I was still hanging out in an IRC channel I started called #42 (e.g. see the 20 year-old but surprisingly tasteful-looking #42 posse page, and don't snooze on those MIDIs!) which was basically just a magnet for random Douglas Adams fans or people who perused the list of channels alphabetically and got bored pretty quickly. But, at this point I've had so many birthdays that it hardly matters.

Sort of for my birthday I finally caved and bought a new fancy graphics card, which I have been trying to do without buying from scalpers for over a year, but that just wasn't working. I got the NVidia RTX 3080 Ti Founders Edition, which is definitely overkill, but I appreciate the industrial design (especially that it is NOT brimming with "gamer" bling) and the fact that it specifically tries to thwart cryptocurrency mining, which is part of the reason these cards are so hard to get, among the many problems with cryptocurrency. It is a very fast card. It runs my custom ML stuff several times faster out of the box (but I still need to do a lot of performance tuning here), it can drive my new monitor at 120hz (which is pretty compelling, I must say, and displaystream compression is completely fine even for these sensitive eyes) including playing some new games at 4k at 60+ fps. So that's great. I did play a lot of video games: I finished Filament; this was good and I do recommend it, although the end was pretty weak after the various mystery build-up, and I did not end up going after all the puzzles. I played through Tetris Effect which is "Tetris but Winamp." I had some fun with the multiplayer (especially the co-op "boss fight" stuff) but the matchmaking is ridiculously bad (90% of games don't even start) so I just got tired of it. For games that actually put the graphics card to the test, I started Psychonauts 2 which is great, and Deathloop which also is pretty intriguing but I haven't gotten far enough to render a real opinion yet. All of a sudden there are so many games I want to play; there's Outer Wilds DLC and Deltarune 2 magically appearing, a new Metroid game soon, Axiom Verge 2, and so on. I'm very impressed that people were able to finish these projects during pandemic (whether working small/solo or on a large team). I haven't been good about it, for sure.

I did finish a few things. As mentioned in the previous post I've upped my classic font game, first starting with this slightly improved version of FixedSys, which I have been using at 2x size on the 4k monitor, which is beautifully chunky:

FixederSys 1x

... but it is a little bit silly to use "pixels" that are 2x2 screen pixels, and it the idea that I could perhaps improve stuff like diagonal lines without sacrificing the computery crispness kept haunting me. So a few weeks ago I cleaned up the 2x bitmap by hand, and I'm pretty happy with it so far:

FixederSys 2x

(These will probably miss the point if you are not using a 1:1 display.)

A bigger project was finally shipping the updates to the Destroy FX plugins with 64-bit support, new GUIs, and other improvements! I think I pretty much posted all the graphical changes throughout the last year here, but I invite you to download them for real now. We got a kick out of seeing the reaction from people (presumably 42 year-olds) who missed these babies from the 90s and 2000s and were surprised to see updates... Some of them had been keeping the plugins alive on a dusty Windows XP machine or inside some janky "laser suspension womb"-style emulation harness, and others had figured they'd just never override their buffers again. I particularly enjoyed this article and some of the excitement on Twitter and forums like this one. I am still hacking on a new experimental effect, but it's so hard to know if it'll be interesting at all until it's much further along!

This weekend we are going to do a trail run in the woods, but I can recap that when I get back. Stay safe.

(5 comments — almost 3 years ago) [ comment ]

Entries from August 2021

p
e
r
s
o
n
a
l

Mostly, vaxcation (31 Aug 2021 at 22:57)

Hello! It's vacation season around here, this time a trip to see some vaccinated and covid-tested friends in northern Michigan on a lake. I thought maybe I'd get some recreational programming done while I was up there, but the atmosphere was a bit more like kids, commotion and party than it was like meditative retreat with just a typewriter and an acoustic guitar, but that was okay too.

Earlier in the month, I worked on adding stuff to my bespoke machine learning setup ("tom7flow"), since I have recurring urges to use this for wacky projects, and a specific thing in mind to try for Destroy FX (of course this very hacking distracted me from just finishing the one last piece of the Buffer Override UI, after which we can just release those bad boys!). I added support for convolutional layers, a classic trick for reducing the number of parameters by repeating the same pattern over and over. For example when trying to do some processing of a NES video frame, of size 256x240, instead of having a layer with 256x240 "pixels" on it with independent weights, you might instead learn weights for an 8x8 block but repeat that 32x30 times. In fact I revived some earlier failed NES ML project (it looks like I never posted about it?) as an example to develop with, and I can at least show you the pretty ways that it distorts NES graphics:

INVENTOR?

I love those dirty pixels. I even "wasted" an additional afternoon building a real-time version that lets me play games through the model at 60fps (also with sound; unnecessary!), and then played glitchy Nintendo games for a while. Unnecessary! And speaking of pixels, with my new high-DPI monitor I've been futzing again with the fonts I use, and I've decided to go back to the venerable FixedSys (my all-time favorite bitmap font), but to use it at 2x size. I like the giant fonts for my aging eyes, but also to reduce the visual distractions when I'm writing or programming. (To be clear the draw of a big high-resolution monitor for me personally is mostly about the visual quality of images, video, and games, not about 'screen real estate' to pack full of blinkenlights and multi-pane IDEs.) In order to revive this font I manually converted it to a fake-bitmap TTF (using previously described convenient tech) and fixed some of the few flaws with the font (e.g. I think the [] characters descend lower than they should) and added some missing unicode characters that I'd like to have around, yielding FixederSys. I managed to get it rendering perfectly in emacs, and I'm really happy with it now! Since I'm using it at 2x, I have in mind that I may be able to improve this font further using the increased bitmap resolution, while still keeping the chunky pixel character that I admire. So I will try that out on some rainy day.

In media news, I finished up Sniper Ghost Warrior II: Contracts: Ghost Killer Snipe Wars or whatever, which was what I was in the mood for, I guess. I finally got around to playing Ghost Trick since they fixed some serious playability issues on iOS. It was creative and great and I endorse the consensus that it's an oft-overlooked gem. Then I started Filament, which is a pretty neat puzzle game that I'm enjoying so far, although I'm not sure I will 100% this one with Psychonauts 2 just sitting there teasing me to be played!

(4 comments — 3 years ago) [ comment ]

... Aug 2021 continued

2
0
2
4

Posts from 2024

Oct Sep Aug Jul Jun May Apr Mar Feb Jan

2
0
2
3

Posts from 2023