QEMU GPU vfio-pci pass through

@white
Do you see anything on the monitor attached to the passed through card? It started but the bios emulator cannot run the BIOS of the card. This may or may not be a problem. If you see nothing on any of the outputs of the passed through card you can try to get a prompt on serial. I forgot that you also need a way for input so you need to add -device bochs-display which will open an empty window that you can type into even if you see nothing. Enter there:
then you should get an ok prompt on serial. You need a space after the first quote char exactly as above. You'll only see more errors while typing but if typed correctly this should get a prompt on serial and then you can use the serial window to enter the boot command.

@Balaton

It was a steep learning curve between Linux Arch etc.
but now I understand how to do it.
I can't do the "/failsafe" io
switch at the moment
I also compiled version 10 beta r3.
A big step forward for me.

But the new qemu syntax you gave me doesn't seem to work.
It keeps crashing giving me a series of errors

Of course I'm not stopping here I'll do more tests
Thanks for your help.

@white
Quote:Did you add -device bochs-display to the qemu args?

As an alternative you could try changing the firmware stdin and stdout from keyboard/display to serial. On U-Boot systems that's done using, but I don't know how it works in the Pegasos2 SmartFirmware.

Quote:That the ancient x86 emulator of the Pegasos2 firmware, and probably the one of the AmigaOne firmware as well, crashes emulating the x86 BIOS ROM code of PCIe gfx cards is normal, not only on qemu, it happens on real hardware with PCI<->PCIe bridges as well.

@joerg
Quote:
Won't work, pegasos2 does not emulate nvram and it's easier to type one line than three so just do " /failsafe" io with space after first " !

@white
If you are lost do this.
Use your old command line with ‘-device VGA,romfile=’ and older qemu.
Run ... wait until these messages are no longer output

outputentering main read/eval loop....
UNHANDLED INT 10 FUNCTION 0300 WITHIN EMULATION
UNHANDLED INT 10 FUNCTION 1301 WITHIN EMULATION


now click on the VGA window and type
boot hd:0 bboot.fth
remember you cannot see what you are typing.

You will see messages in the console for a while.

That's it

in the first place I would still check if you have GPU passthrough on some "iso" of Linux on qemu-system_x86_64.
You have plenty of examples - an example here in the description of ‘QEMU’ do it like this.

@white
Quote:
What do you mean by crashing? Seeing the errors from BIOS emulator in firmware is normal, don't care about those. Just try typing after clicking in the window that says guest has not initialized display yet. To get that window you need to add -device bochs-display to QEMU command line. While typing there you might see more errors but don't care about them. If you typed the command correctly with space after first quote and no typos then you should see an ok prompt where you got the emulation errors before. Then you can leave the guest window with Ctrl+Alt+g and can use the ok prompt to enter the boot hd bboot.fth command (after you've copied bboot, bboot.fth and Kickstart.zip to the boot volume as we said before).

@smarkusg
Quote:
Don't do that. Adding that VGA card prevents the passed through card BIOS to access VGA ports. Even if the BIOS does not run correctly it may be needed to init the card correctly so don't add any other VGA device just the passed through card. The bochs-display does not have VGA part so you can use that. It's true you can also type the boot command instead of the " /failsafe" io blindly, it's just easier to see what you do so getting a prompt may help.

@balaton

AHA ok - sorry
I checked this the other day on the fly - so my mistake.

@white
don't do what I wrote to you

@joerg
yes I added -device bochs-display
then I go to parallel and even if the screen is black I type:
" /failsafe" io

the problem is that I can't give that command because the pegasos2 boot crashes first with all the codes incomprehensible to me.
And I don't get to the boot prompt

example:

INTERNAL ERROR: 0000000E=UNIMPLEMENTED EXTENDED OPCODE

EAX=0000 EBX=0000 ECX=0000 EDX=0000 ESP=0000 EBP=5555 ESI=6666 EDI=7777
AX=0008 BX=0004 CX=3A98 DX=0014 SP=FFC8 BP=FFB6 SI=0008 DI=A298
DS=C000 ES=BAD0 SS=1000 CS=C000 IP=3288 NV UP -- PL NZ NA PO NC
CS:IP = 0F
STACK: 0008 0008 15B9 0004 162B 07F2 02B7 0000
00: FE00 F000 FE01 F000 FE02 F000 FE03 F000
10: FE04 F000 FE05 F000 FE06 F000 FE07 F000
20: FE08 F000 FE09 F000 FE0A F000 FE0B F000
30: FE0C F000 FE0D F000 FE0E F000 FE0F F000
40: FE10 F000 FE11 F000 FE12 F000 FE13 F000
50: FE14 F000 FE15 F000 FE16 F000 FE17 F000
60: FE18 F000 FE19 F000 FE1A F000 FE1B F000
70: FE1C F000 FE1D F000 FE1E F000 FE1F F000
80: FE20 F000 FE21 F000 FE22 F000 FE23 F000
90: FE24 F000 FE25 F000 FE26 F000 FE27 F000
A0: FE28 F000 FE29 F000 FE2A F000 FE2B F000
B0: FE2C F000 FE2D F000 FE2E F000 FE2F F000
C0: FE30 F000 FE31 F000 FE32 F000 FE33 F000
D0: FE34 F000 FE35 F000 FE36 F000 FE37 F000
E0: FE38 F000 FE39 F000 FE3A F000 FE3B F000
F0: FE3C F000 FE3D F000 FE3E F000 FE3F F000
00: FE40 F000 FE41 F000 FE42 F000 FE43 F000
10: FE44 F000 FE45 F000 FE46 F000 FE47 F000
20: FE48 F000 FE49 F000 FE4A F000 FE4B F000
30: FE4C F000 FE4D F000 FE4E F000 FE4F F000
Failed to emulate CS:IP [C000:3288]=0F,BC,D8,8D,36,95
UNHANDLED INT 10 FUNCTION 0100 WITHIN EMULATION
EA: BYTE READ FROM UNINITIALIZED LOW MEM 0040:0085
UNHANDLED INT 10 FUNCTION 0300 WITHIN EMULATION

Tomorrow I'll try to put the GPUs back as they were before to see if it was Ubuntu that gave the time-out.
Or is Arch that works better and there is no need to move the GPUs.
Although in some cases it is advisable to move them.

For the more experienced @Balaton first if these videos can help you simplify things for qemu PCI and also to give you a hint for your work with qemu.

I'll leave 2 links where I got my inspiration and I did some research on IOMMU and Vfio PCI

https://www.youtube.com/watch?v=qQiMMeVNw-o
https://www.youtube.com/watch?v=uOuzFd8Gd2o

@white
I wrote above quite a few times now that you MUST PUT A SPACE BETWEEN " AND / IN THE " /failsafe" io command. If you did not do that and typed what you posted above then that's why you don't get the ok prompt. Or you're typing it in the wrong window. After adding -device bochs-display to QEMU command you should see a black window with text in the middle saying the guest did not init display. That's where you should type and while typing you would see more errors on the serial window. If you typed the command correctly it should give you an ok prompt where the errors were. Then you can leave the black window. You won't see anything in the black window, it's just to capture keyboard and mouse events for the guest.

By the way, anybody else managed to get it work following this thread?

@Balaton
no additional black window opens
only the two windows ( I'm using qemu beta 10 rc3 now )
here:

@white
The bochs-display also has a rom by default that also crashes. So disable it and use -device bochs-display,romfile="" instead. You don't get separate windows because using gtk display where these are tabs or available from the view menu. Type the " /failsafe" io command in the bochs-display window/tab whatever it is. To see the output from the passed through card you need a monitor connected to it, you won't see anything from that on the host.

@Balaton

Ok now I try

I have only one doubt
Probably in the "parallel" terminal
if that's where you enter the command
" /failsafe" io
the keyboard is not Italian and therefore the characters I enter are not correct.
I happened to use the qemu terminal and even having the keyboard set to Italian it continued to write with the English keyboard and therefore the characters were not correct in the "monitor" terminal

@Balaton
tried in qemu compat-monitor terminal the keyboard is Italian and the symbols are correct

@white
It's quite possible that the pegasos2.rom defaults to English keyboard as there's no way to configure keyboard that early so this can also be a problem. This would be the same as on real machine where the firmware probably also uses English layout and only when the OS boots will it change to other layout. Also I don't know what you call "parallel" terminal but it's what says Guest has not initialized display (yet) and should be labelled bochs-display in the view menu. There may also be a parallel0 window but that's not what you need, that shows data from the parallel port.

@Balaton
no box or black window appears where to enter the command


sudo qemu-system-ppc -M pegasos2 -m 1024 -bios /home/white/Scaricati/pegasos2.rom -serial stdio -drive media=disk,format=raw,file=/home/white/Scaricati/32gb.raw -drive media=disk,format=raw,file=/home/white/Scaricati/coffin.raw -netdev user,id=net -device rtl8139,netdev=net -vga none -device vfio-pci,host=06:00.0,bus=pci.0,x-vga=on,multifunction=on -device vfio-pci,host=06:00.1,bus=pci.0 -device bochs-display,romfile=""

@white
Quote:
That one is handled by QEMU so it may use your host's layout but the guest window is handled by pegasos2.rom which has no way to know you're using what layout so it likely defaults to English keyboard.

@white
What do you have in the menu "Visualizza"?

@Balaton

this: