Note the following important identity for augmented isometric affine matrices:
$$
\begin{pmatrix}
cos\theta & sin\theta & -(xcos\theta + ysin\theta)\\
-sin\theta & cos\theta & -(-xsin\theta + ycos\theta)\\
0 & 0 & 1
\end{pmatrix}
\begin{pmatrix}
cos\theta & -sin\theta & u\\
sin\theta & cos\theta & v\\
0 & 0 & 1\\
\end{pmatrix}
\begin{pmatrix}
x\\y\\1\\
\end{pmatrix}
=
\begin{pmatrix}
x\\y\\1\\
\end{pmatrix}
$$
where the isometric condition is recognized from: \$cos^2\theta + sin^2\theta=1\$ and \$\begin{pmatrix}u\\v\end{pmatrix}\$
is the translation in world coordinates of your original transformation.
In vector terms, if you think of your original transformation as being
$$
\begin{pmatrix}
R & T\\
0 & 1\\
\end{pmatrix}
$$
then the inverse transformation, to return to World Coordinates is simply
$$
\begin{pmatrix}
R^{-1} & -R^{-1}T\\
0 & 1\\
\end{pmatrix}
$$
where because of isometry the inverse of R is simply the transpose of R, as noted above.
In vector form the initial identity is just
$$
\begin{pmatrix}
R^{-1} & -R^{-1}T\\
0 & 1\\
\end{pmatrix}
\begin{pmatrix}
R & T\\
0 & 1\\
\end{pmatrix}
\begin{pmatrix}
v\\1
\end{pmatrix}
=
\begin{pmatrix}
v\\1
\end{pmatrix}
$$
which is readily proved by multiplying out to get first
$$
\begin{pmatrix}
R^{-1} & -R^{-1}T\\
0 & 1\\
\end{pmatrix}
\begin{pmatrix}
Rv + T\\1\\
\end{pmatrix}
=
\begin{pmatrix}
v\\1
\end{pmatrix}
$$
and then reducing the left hand side as
$$
\begin{pmatrix}
R^{-1}Rv + R^{-1}T-R^{-1}T\\1\\
\end{pmatrix}
=
\begin{pmatrix}
R^{-1}Rv\\1\\
\end{pmatrix}
=
\begin{pmatrix}
v\\1
\end{pmatrix}
$$
Q.E.D.
Note also that the vector form of the identity is not specific to only a 2D space, but applies to any number of spatial dimensions.