If you just removed the drain plug, then you should not have had access to the gasket. If you unscrewed the drain fitting, then the gasket would have been loose since it was not longer being clamped by the drain fitting. But, if you did that and the elbow was not connected to anything then it should have fallen off and dropped into the hole under the tub. Obviously that did not happen, so what is holding it in place? Whatever that is may be the drain’s connection.