Charging port

[iZIGGA]

Every time i replace a charging port i cant seem to fit it back in place because of the rubber piece that is left in
the top left corner of the charging port area. How can i fit the charging port back in place with the rubber
piece still in there?