Well I think I got it. I made the categorylink that is the relational table an inner join so it looks like this:
SELECT *
FROM itemcategorylink INNER JOIN items ON items.ItemID = itemcategorylink.ItemID
WHERE ItemCatID = colname
It seems to work but I'll have to test more to confirm.