This only has to be installed into the server's mods folder.
To ignore the frame entity it has to be installed onto the server unfortunately.
What the mod does:
Allows the user to right-click on a item frame to access the chest behind it, made for item frame organized chest. Crouching allows the user to interact with the item frames normal behavior.
Made specifically for 1.21.4 using Fabric 0.16.13, I have no idea if this works on any other fabric version, this is my first mod.