Câu b:

\(\left\{\begin{matrix} x(y-1)+2y=x(x+1)(1)\\ \sqrt{2x-1}+xy-3y+1=0(2)\end{matrix}\right.\)

Từ \((1)\Leftrightarrow y(x+2)=x(x+1)+x\)

\(\Leftrightarrow y(x+2)=x(x+2)\Leftrightarrow (x+2)(y-x)=0\)

\(\Rightarrow \left[\begin{matrix} x=-2\\ x=y\end{matrix}\right.\)

Nếu \(x=-2\) thay vào (2) thấy ngay vô lý vì ĐKXĐ là \(x\geq \frac{1}{2}\)

Nếu \(x=y\), thay vào (2): \(\sqrt{2x-1}+x^2-3x+1=0\)

\(\Leftrightarrow (\sqrt{2x-1}-x)+(x^2-2x+1)=0\)

\(\Leftrightarrow \frac{2x-1-x^2}{\sqrt{2x-1}+x}+(x-1)^2=0\)

\(\Leftrightarrow (x-1)^2\left[1-\frac{1}{\sqrt{2x-1}+x}\right]=0\)

\(\Rightarrow \left[\begin{matrix} x=1\\ \sqrt{2x-1}+x=1\end{matrix}\right.\)

Với trường hợp \(\sqrt{2x-1}+x=1(x\leq 1)\Rightarrow \sqrt{2x-1}=1-x\)

\(\Rightarrow 2x-1=(1-x)^2=x^2-2x+1\)

\(\Leftrightarrow x^2-4x+2=0\Rightarrow x=2\pm \sqrt{2}\). Vì \(\frac{1}{2}\leq x\leq 1\Rightarrow x=2-\sqrt{2}\)

Vậy \((x,y)=(1,1); (2-\sqrt{2}; 2-\sqrt{2})\)