Yes, that’s the stuff. That pic is a bit misleading as they cross cut it to show the profile. Normal 3/4 or 5/8 sheathing will have male edge on a short and long side and a female edge on the opposite long and short sides.
For your use it won’t really matter, just use some sheathing...