Hello,

Sometimes, i have following errors on main syslog-ng server :

Spoiler

 

2020-03-07T12:59:50+01:00 s_dev_kernel_kmsg@srv-orangepir1-140-user kernel: 3,996,16878692493,-;mmc0: Card stuck in programming state! mmc_do_erase
2020-03-07T12:59:50+01:00 s_dev_kernel_kmsg@srv-orangepir1-140-user kernel: 3,997,16878692530,-;blk_update_request: I/O error, dev mmcblk0, sector 10335392 op 0x3:(DISCARD) flags 0x0 phys_seg 1 prio class 0
2020-03-07T12:59:50+01:00 s_dev_kernel_kmsg@srv-orangepir1-140-user kernel: 3,998,16878692736,-;mmc_erase: group start error -110, status 0x0
2020-03-07T12:59:50+01:00 s_dev_kernel_kmsg@srv-orangepir1-140-user kernel: 3,999,16878692755,-;blk_update_request: I/O error, dev mmcblk0, sector 10466560 op 0x3:(DISCARD) flags 0x0 phys_seg 1 prio class 0
2020-03-07T12:59:50+01:00 s_dev_kernel_kmsg@srv-orangepir1-140-user kernel: 3,1000,16878692885,-;sunxi-mmc 1c0f000.mmc: data error, sending stop command
2020-03-07T12:59:50+01:00 srv-orangepir1-140-service/srv-orangepir1-140-service SUBSYSTEM=platform
2020-03-07T12:59:50+01:00 srv-orangepir1-140-service/srv-orangepir1-140-service DEVICE=+platform:1c0f000.mmc
2020-03-07T12:59:50+01:00 s_dev_kernel_kmsg@srv-orangepir1-140-user kernel: 3,1001,16878692905,-;sunxi-mmc 1c0f000.mmc: send stop command failed
2020-03-07T12:59:50+01:00 srv-orangepir1-140-service/srv-orangepir1-140-service SUBSYSTEM=platform
2020-03-07T12:59:50+01:00 srv-orangepir1-140-service/srv-orangepir1-140-service DEVICE=+platform:1c0f000.mmc

After this  error, not possible  to connect via  ssh  on target ..

When trying to connect on local tty, then following error in loop...

Port /dev/tty-target-srv-orangepir1-140-position-1.2.4.4.3

Press CTRL-A Z for help on special keys

êRead-error on swap-device (179:0:918360)
[18207.712698] Kernel panic - not syncing: Attempted to kill init! exitcode=0x00000007
[18207.720401] CPU: 1 PID: 1 Comm: init Not tainted 5.5.0-sunxi #trunk.034
[18207.727030] Hardware name: Allwinner sun8i Family
[18207.731774] [<c010db0d>] (unwind_backtrace) from [<c010a139>] (show_stack+0x11/0x14)
[18207.739997] [<c010a139>] (show_stack) from [<c0962e6b>] (dump_stack+0x6f/0x7c)
[18207.747329] [<c0962e6b>] (dump_stack) from [<c011b99d>] (panic+0xcd/0x24c)
[18207.754210] [<c011b99d>] (panic) from [<c011fc39>] (do_exit+0x86d/0x884)
[18207.760914] [<c011fc39>] (do_exit) from [<c011fcab>] (do_group_exit+0x2f/0x84)
[18207.768142] [<c011fcab>] (do_group_exit) from [<c01288e7>] (get_signal+0x127/0x740)
[18207.775804] [<c01288e7>] (get_signal) from [<c0109a5f>] (do_work_pending+0xc3/0x42c)
[18207.783552] [<c0109a5f>] (do_work_pending) from [<c0101077>] (slow_work_pending+0x9/0x16)
[18207.791729] Exception stack(0xcf8f9fb0 to 0xcf8f9ff8)
[18207.796783] 9fa0:                00d3f8a4 004d833c b6e94000 0000015c
[18207.804964] 9fc0: 00d3f8a4 bec257ec 004d8324 004e921c 00d3f880 004e9000 00d3f8a4 0000004e
[18207.813143] 9fe0: 004e918c bec256b0 b6df990d b6df91f6 00010030 ffffffff
[18207.819766] CPU3: stopping
[18207.822484] CPU: 3 PID: 0 Comm: swapper/3 Not tainted 5.5.0-sunxi #trunk.034
[18207.829530] Hardware name: Allwinner sun8i Family
[18207.834243] [<c010db0d>] (unwind_backtrace) from [<c010a139>] (show_stack+0x11/0x14)
[18207.841992] [<c010a139>] (show_stack) from [<c0962e6b>] (dump_stack+0x6f/0x7c)
[18207.849221] [<c0962e6b>] (dump_stack) from [<c010ca33>] (handle_IPI+0x293/0x2bc)
[18207.856626] [<c010ca33>] (handle_IPI) from [<c05e3345>] (gic_handle_irq+0x69/0x6c)
[18207.864203] [<c05e3345>] (gic_handle_irq) from [<c0101ae5>] (__irq_svc+0x65/0x94)
[18207.871685] Exception stack(0xcf923f58 to 0xcf923fa0)
[18207.876737] 3f40:                      00000000 00a95dd8
[18207.884918] 3f60: cfd71fb4 c0116341 ffffe000 c0f04f68 c0f04fb0 00000008 c0f04f48 00000000
[18207.893099] 3f80: c0ec88f0 00000000 c0f03d00 cf923fa8 c01079bf c01079c0 400f0033 ffffffff
[18207.901282] [<c0101ae5>] (__irq_svc) from [<c01079c0>] (arch_cpu_idle+0x28/0x2c)
[18207.908687] [<c01079c0>] (arch_cpu_idle) from [<c014033f>] (do_idle+0x16b/0x1e8)

U-Boot SPL 2019.04-armbian (Jul 06 2019 - 00:26:54 +0200)

As a result, the only solution to this issue is the physical on/off on
target (remove then insert power cable (!))

Configuration is ... (after reboot)

root@srv-orangepir1-140:~# uname -a                                                 
Linux srv-orangepir1-140 5.5.0-sunxi #trunk.034 SMP Mon Feb 3 08:38:40 CET 2020 armv7l GNU/Linux                        
root@srv-orangepir1-140:~# cat /etc/debian_version                                           
10.3                                                              
root@srv-orangepir1-140:~# grep -iR ^Deb /etc/apt                                            
/etc/apt/sources.list.d/debian_apt_v_10_buster_backports.list:deb http://ftp.fr.debian.org/debian buster-backports main contrib non-free        
/etc/apt/sources.list.d/debian_apt_v_10_buster_previous.list:deb http://ftp.debian.org/debian/ stretch main contrib non-free              
/etc/apt/sources.list.d/debian_apt_v_10_buster_update_security.list:deb http://security.debian.org buster/updates main contrib non-free         
/etc/apt/sources.list.d/armbian_apt_v_10_buster.list:deb http://apt.armbian.com buster main buster-utils buster-desktop                
/etc/apt/sources.list.d/debian_apt_v_10_buster_current.list:deb http://ftp.debian.org/debian/ buster main contrib non-free             
/etc/apt/sources.list.d/debian_apt_v_10_buster_updates.list:deb http://ftp.fr.debian.org/debian buster-updates main contrib non-free         

root@srv-orangepir1-140:~# grep -iR ^P /etc/apt/preferences.d/
/etc/apt/preferences.d/preferences_debian_v_10_buster.pref:Package: *
/etc/apt/preferences.d/preferences_debian_v_10_buster.pref:Pin: release o=Debian,l=Debian,n=buster/updates
/etc/apt/preferences.d/preferences_debian_v_10_buster.pref:Pin-Priority: 920
/etc/apt/preferences.d/preferences_debian_v_10_buster.pref:Package: *
/etc/apt/preferences.d/preferences_debian_v_10_buster.pref:Pin: release o=Debian,l=Debian,n=buster-update
/etc/apt/preferences.d/preferences_debian_v_10_buster.pref:Pin-Priority: 910
/etc/apt/preferences.d/preferences_debian_v_10_buster.pref:Package: *
/etc/apt/preferences.d/preferences_debian_v_10_buster.pref:Pin: release o=Debian,l=Debian,n=buster
/etc/apt/preferences.d/preferences_debian_v_10_buster.pref:Pin-Priority: 900
/etc/apt/preferences.d/preferences_debian_v_10_buster.pref:Package: *
/etc/apt/preferences.d/preferences_debian_v_10_buster.pref:Pin: release o=Debian,l=Debian,n=buster-backports
/etc/apt/preferences.d/preferences_debian_v_10_buster.pref:Pin-Priority: -1
/etc/apt/preferences.d/preferences_debian_v_10_buster.pref:Package: *
/etc/apt/preferences.d/preferences_debian_v_10_buster.pref:Pin: release o=Debian,l=Debian,n=stretch
/etc/apt/preferences.d/preferences_debian_v_10_buster.pref:Pin-Priority: 400
/etc/apt/preferences.d/preferences_debian_v_10_buster.pref:Package: *
/etc/apt/preferences.d/preferences_debian_v_10_buster.pref:Pin: release o=Debian,l=Debian,n=testing
/etc/apt/preferences.d/preferences_debian_v_10_buster.pref:Pin-Priority: -1
/etc/apt/preferences.d/preferences_debian_v_10_buster.pref:Package: *
/etc/apt/preferences.d/preferences_debian_v_10_buster.pref:Pin: release o=Debian,l=Debian,n=unstable
/etc/apt/preferences.d/preferences_debian_v_10_buster.pref:Pin-Priority: -1
/etc/apt/preferences.d/preferences_debian_v_10_buster_no_elogind.pref:Package: elogind
/etc/apt/preferences.d/preferences_debian_v_10_buster_no_elogind.pref:Pin: release *
/etc/apt/preferences.d/preferences_debian_v_10_buster_no_elogind.pref:Pin-Priority: -1
/etc/apt/preferences.d/preferences_debian_v_10_buster_no_dhcpcd5.pref:Package: dhcpcd5
/etc/apt/preferences.d/preferences_debian_v_10_buster_no_dhcpcd5.pref:Pin: release *
/etc/apt/preferences.d/preferences_debian_v_10_buster_no_dhcpcd5.pref:Pin-Priority: -1
/etc/apt/preferences.d/preferences_debian_v_10_buster_no_systemd.pref:Package: systemd
/etc/apt/preferences.d/preferences_debian_v_10_buster_no_systemd.pref:Pin: release *
/etc/apt/preferences.d/preferences_debian_v_10_buster_no_systemd.pref:Pin-Priority: -1
/etc/apt/preferences.d/preferences_armbian_buster.pref:Package: hostapd
/etc/apt/preferences.d/preferences_armbian_buster.pref:Pin: origin "apt.armbian.com"
/etc/apt/preferences.d/preferences_armbian_buster.pref:Pin-Priority: -1
/etc/apt/preferences.d/preferences_armbian_buster.pref:Package: *
/etc/apt/preferences.d/preferences_armbian_buster.pref:Pin: origin "apt.armbian.com"
/etc/apt/preferences.d/preferences_armbian_buster.pref:Pin-Priority: 500
root@srv-orangepir1-140:~#

root@srv-orangepir1-140:~# dpkg -l |grep linux-image
ii  linux-image-dev-sunxi        20.05.0-trunk.034 armhf     Linux kernel, version 5.5.0-sunxi
ii  linux-image-next-sunxi       5.92              armhf     Linux kernel, version 4.19.62-sunxi
root@srv-orangepir1-140:~#

 

 

Dev branch / images built from trunk are unsupported.

Try with a supported image and check if the issue persists.

Ok, thank for your reply.

 

As a result, i have installed 4.19.62-sunxi kernel,  and the target booting process is OK.

But the bad news is that behavior is the same .....

 

root@srv-orangepir1-140:~# [10693.955976] EXT4-fs error (device dm-26): ext4_find_entry:1455: inode #12: comm apt: reading directory lblock 0

Spoiler

[10693.966714] EXT4-fs error (device dm-26): ext4_find_entry:1455: inode #12: comm apt: reading directory lblock 0
[10693.977622] EXT4-fs error (device dm-26): ext4_find_entry:1455: inode #12: comm apt: reading directory lblock 0
[10693.988024] EXT4-fs error (device dm-26): ext4_find_entry:1455: inode #12: comm apt: reading directory lblock 0
[10693.998574] EXT4-fs error (device dm-26): ext4_find_entry:1455: inode #12: comm apt: reading directory lblock 0
[10694.008896] EXT4-fs error (device dm-26): ext4_find_entry:1455: inode #12: comm apt: reading directory lblock 0
[10694.019195] EXT4-fs error (device dm-26): ext4_find_entry:1455: inode #12: comm apt: reading directory lblock 0
[10694.029590] EXT4-fs error (device dm-26): ext4_find_entry:1455: inode #12: comm apt: reading directory lblock 0
[10694.040134] EXT4-fs error (device dm-26): ext4_find_entry:1455: inode #12: comm apt: reading directory lblock 0
[10694.050567] EXT4-fs error (device dm-26): ext4_find_entry:1455: inode #12: comm apt: reading directory lblock 0
[10695.634222] EXT4-fs error (device mmcblk0p1): ext4_journal_check_start:61: Detected aborted journal
[10695.643330] EXT4-fs (mmcblk0p1): Remounting filesystem read-only
[10695.650153] EXT4-fs error (device mmcblk0p1): ext4_find_entry:1455: inode #2: comm monit: reading directory lblock 0
[10696.703714] EXT4-fs error (device mmcblk0p1): ext4_find_entry:1455: inode #133342: comm monit: reading directory lblock 0
[10696.715499] EXT4-fs error (device mmcblk0p1): ext4_find_entry:1455: inode #2: comm monit: reading directory lblock 0
[10696.726225] EXT4-fs error (device mmcblk0p1): ext4_find_entry:1455: inode #2: comm monit: reading directory lblock 0
[10696.736882] EXT4-fs error (device mmcblk0p1): ext4_find_entry:1455: inode #2: comm monit: reading directory lblock 0
[10696.747567] EXT4-fs error (device mmcblk0p1): ext4_find_entry:1455: inode #2: comm monit: reading directory lblock 0
[10696.758211] EXT4-fs error (device mmcblk0p1): ext4_find_entry:1455: inode #2: comm monit: reading directory lblock 0
[10696.768912] EXT4-fs error (device mmcblk0p1): ext4_find_entry:1455: inode #133378: comm monit: reading directory lblock 0
[10696.782358] EXT4-fs error (device mmcblk0p1): ext4_wait_block_bitmap:511: comm monit: Cannot read block bitmap - block_group = 20, block_bitmap = 524292
[10696.796062] EXT4-fs error (device mmcblk0p1): ext4_discard_preallocations:4065: comm monit: Error -5 loading buddy information for 20
[10712.057406] EXT4-fs error (device mmcblk0p1): ext4_find_entry:1455: inode #2: comm cron: reading directory lblock 0
[10712.068115] EXT4-fs error (device mmcblk0p1): ext4_find_entry:1455: inode #2: comm cron: reading directory lblock 0
[10712.081635] EXT4-fs error (device mmcblk0p1): ext4_find_entry:1455: inode #35043: comm cron: reading directory lblock 0
[10712.092836] EXT4-fs error (device mmcblk0p1): ext4_find_entry:1455: inode #2: comm cron: reading directory lblock 0
[10712.103450] EXT4-fs error (device mmcblk0p1): ext4_find_entry:1455: inode #2: comm cron: reading directory lblock 0
[10712.114061] EXT4-fs error (device mmcblk0p1): ext4_find_entry:1455: inode #2: comm cron: reading directory lblock 0
[10712.124644] EXT4-fs error (device mmcblk0p1): ext4_find_entry:1455: inode #35043: comm cron: reading directory lblock 0
[10757.865768] Kernel panic - not syncing: Attempted to kill init! exitcode=0x00000007
[10757.865768]
[10757.875296] CPU: 3 PID: 1 Comm: init Tainted: G        W         4.19.62-sunxi #5.92
[10757.883251] Hardware name: Allwinner sun8i Family
[10757.887989] [<c010d74d>] (unwind_backtrace) from [<c010a2f1>] (show_stack+0x11/0x14)
[10757.895748] [<c010a2f1>] (show_stack) from [<c08fc121>] (dump_stack+0x69/0x78)
[10757.902983] [<c08fc121>] (dump_stack) from [<c011b3f5>] (panic+0xb9/0x1cc)
[10757.909867] [<c011b3f5>] (panic) from [<c011f289>] (complete_and_exit+0x1/0x18)
[10757.917183] [<c011f289>] (complete_and_exit) from [<cf8e5e54>] (0xcf8e5e54)
[10757.924153] CPU1: stopping
[10757.926872] CPU: 1 PID: 0 Comm: swapper/1 Tainted: G        W         4.19.62-sunxi #5.92
[10757.935047] Hardware name: Allwinner sun8i Family
[10757.939760] [<c010d74d>] (unwind_backtrace) from [<c010a2f1>] (show_stack+0x11/0x14)
[10757.947510] [<c010a2f1>] (show_stack) from [<c08fc121>] (dump_stack+0x69/0x78)
[10757.954739] [<c08fc121>] (dump_stack) from [<c010c7fb>] (handle_IPI+0x2a7/0x2c0)
[10757.962146] [<c010c7fb>] (handle_IPI) from [<c05c9c7f>] (gic_handle_irq+0x67/0x68)
[10757.969725] [<c05c9c7f>] (gic_handle_irq) from [<c0101a65>] (__irq_svc+0x65/0x94)
[10757.977208] Exception stack(0xcf91df60 to 0xcf91dfa8)
[10757.982265] df60: 00000000 003d69e4 cfd48438 c0116441 ffffe000 c0e04d70 c0e04db8 00000002
[10757.990446] df80: 00000000 c0e04d48 c0dba870 00000000 c0e03d00 cf91dfb0 c01078f3 c01078f4
[10757.998622] dfa0: 40010133 ffffffff
[10758.002120] [<c0101a65>] (__irq_svc) from [<c01078f4>] (arch_cpu_idle+0x28/0x2c)
[10758.009526] [<c01078f4>] (arch_cpu_idle) from [<c013e96b>] (do_idle+0x14b/0x1d8)
[10758.016928] [<c013e96b>] (do_idle) from [<c013ebed>] (cpu_startup_entry+0x19/0x1c)
[10758.024502] [<c013ebed>] (cpu_startup_entry) from [<401024b1>] (0x401024b1)
[10758.031464] CPU2: stopping
[10758.034180] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G        W         4.19.62-sunxi #5.92
[10758.042355] Hardware name: Allwinner sun8i Family
[10758.047068] [<c010d74d>] (unwind_backtrace) from [<c010a2f1>] (show_stack+0x11/0x14)
[10758.054817] [<c010a2f1>] (show_stack) from [<c08fc121>] (dump_stack+0x69/0x78)
[10758.062045] [<c08fc121>] (dump_stack) from [<c010c7fb>] (handle_IPI+0x2a7/0x2c0)
[10758.069449] [<c010c7fb>] (handle_IPI) from [<c05c9c7f>] (gic_handle_irq+0x67/0x68)
[10758.077024] [<c05c9c7f>] (gic_handle_irq) from [<c0101a65>] (__irq_svc+0x65/0x94)
[10758.084507] Exception stack(0xcf91ff60 to 0xcf91ffa8)
[10758.089563] ff60: 00000000 00479ea4 cfd5a438 c0116441 ffffe000 c0e04d70 c0e04db8 00000004
[10758.097744] ff80: 00000000 c0e04d48 c0dba870 00000000 c0e03d00 cf91ffb0 c01078f3 c01078f4
[10758.105920] ffa0: 400f0133 ffffffff
[10758.109416] [<c0101a65>] (__irq_svc) from [<c01078f4>] (arch_cpu_idle+0x28/0x2c)
[10758.116818] [<c01078f4>] (arch_cpu_idle) from [<c013e96b>] (do_idle+0x14b/0x1d8)
[10758.124220] [<c013e96b>] (do_idle) from [<c013ebed>] (cpu_startup_entry+0x19/0x1c)
[10758.131794] [<c013ebed>] (cpu_startup_entry) from [<401024b1>] (0x401024b1)
[10758.138753] CPU0: stopping
[10758.141469] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G        W         4.19.62-sunxi #5.92
[10758.149644] Hardware name: Allwinner sun8i Family
[10758.154356] [<c010d74d>] (unwind_backtrace) from [<c010a2f1>] (show_stack+0x11/0x14)
[10758.162105] [<c010a2f1>] (show_stack) from [<c08fc121>] (dump_stack+0x69/0x78)
[10758.169334] [<c08fc121>] (dump_stack) from [<c010c7fb>] (handle_IPI+0x2a7/0x2c0)
[10758.176737] [<c010c7fb>] (handle_IPI) from [<c05c9c7f>] (gic_handle_irq+0x67/0x68)
[10758.184312] [<c05c9c7f>] (gic_handle_irq) from [<c0101a65>] (__irq_svc+0x65/0x94)
[10758.191795] Exception stack(0xc0e01f18 to 0xc0e01f60)
[10758.196846] 1f00:                                                       00000000 01d3b36c
[10758.205027] 1f20: cfd36438 c0116441 ffffe000 c0e04d70 c0e04db8 00000001 00000000 c0e04d48
[10758.213208] 1f40: c0dba870 00000000 00000001 c0e01f68 c01078f3 c01078f4 40070033 ffffffff
[10758.221390] [<c0101a65>] (__irq_svc) from [<c01078f4>] (arch_cpu_idle+0x28/0x2c)
[10758.228792] [<c01078f4>] (arch_cpu_idle) from [<c013e96b>] (do_idle+0x14b/0x1d8)
[10758.236194] [<c013e96b>] (do_idle) from [<c013ebed>] (cpu_startup_entry+0x19/0x1c)
[10758.243772] [<c013ebed>] (cpu_startup_entry) from [<c0d00bad>] (start_kernel+0x3a7/0x3c6)
[10758.251958] Rebooting in 10 seconds..

U-Boot SPL 2019.04-armbian (Jul 06 2019 - 00:26:54 +0200)
DRAM: 256 MiB
Trying to boot from MMC1

U-Boot 2019.04-armbian (Jul 06 2019 - 00:26:54 +0200) Allwinner Technology

CPU:   Allwinner H3 (SUN8I 1680)
Model: Xunlong Orange Pi R1
DRAM:  256 MiB
MMC:   mmc@1c0f000: 0, mmc@1c10000: 1
Loading Environment from EXT4... ** File not found /boot/boot.env **

** Unable to read "/boot/boot.env" from mmc0:1 **
In:    serial
Out:   serial
Err:   serial
Net:   phy interface0
eth0: ethernet@1c30000
starting USB...
USB0:   USB EHCI 1.00
USB1:   USB OHCI 1.0
USB2:   USB EHCI 1.00
USB3:   USB EHCI 1.00
USB4:   USB OHCI 1.0
scanning bus 0 for devices... 1 USB Device(s) found
scanning bus 1 for devices... 1 USB Device(s) found
scanning bus 2 for devices... 1 USB Device(s) found
scanning bus 3 for devices...

 

My SDCARD is a class 10 , and no issue on other embedded boards,

 

4.19.62 is quite old and not supported either. Grab a supported image from here: https://www.armbian.com/orange-pi-r1/

Support forums for H2+ devices is here: https://forum.armbian.com/forum/13-allwinner-h2-h3/

Dont forget to add armbianmonitor -u

Use spoiler/code BB-code to increase readability.

11 hours ago, Jean-Marc said:

But the bad news is that behavior is the same

Is this the only HW / SD card combination you have? On a quick scan it looks like a problem with hardware.

We need (someone) to recreate and full logs with armbianmonitor to proceed.