Saw Goblyn's entry mentioned in the Appearances forum, could have sworn I remember Box IV and Manikin being in there somewhere too, so I dug out my old issues (what few I have).
Box IV is in issue #1, Mannikin and Maison Alpha (complete with floor plans) are in issue #4, and Persuasion is in issue #5. Those are the only ones I have though, unfortunately.
ETA: There seems to be a few more various Handbook entries missing and some are a bit mixed up. Lesse what I can add for posterity.
From the Original OHOTMU:
1: Alpha Flight and Aurora
4: Guardian
7: Marrina
8: Northstar and Puck
9: Sasquatch and Shaman
10: Snowbird
From the Deluxe Edition:
1: Alpha Flight and Aurora
2: Box I, II, and III
6: Madison Jeffries
8: Marrina
9: Northstar and Omega Flight
10: Puck
11: Sasquatch
13: Talisman (Elizabeth and Michael)
14: Vindicator
17: Guardian
19: Snowbird
I have too much time on my hands.