What is the biggest issue with genetic engineering?

Could you elaborate on the primary concern surrounding genetic engineering? Could you highlight the most significant challenges or drawbacks associated with this field? Is there a particular aspect of genetic modification that raises the most questions or concerns among experts and the public alike? How does this issue potentially impact individuals, society, or the environment at large? Could you please explain the reasoning behind this being the most pressing matter related to genetic engineering?