There are some exceptions to this rule. For example, it is legal to use live goldfish as bait in some private ponds or lakes if you have permission from the owner of the property. It is also legal to use live goldfish as bait in some areas where goldfish are considered to be an invasive species.
If you are not sure whether it is legal to use live goldfish as bait in your area, you should contact your local fish and wildlife agency.