Yes, you can use the GBA with the GC/GBA link, but you can only use the GBA as a controller. You cannot have a cartridge in the system... otherwise the GBP will malfunction. BTW, just buy an AC adaptor so you can plug your GBA into a wall socket. It's worth it when playing games at home.
~ SA Tails