Testers needed: new Live Installer

SolydXK is too quiet for you? SolydXK Enthusiast Editions, based on Debian Testing is for you! Here you can find news about Debian Testing and Unstable too, and also tests on SolydXK programs.
The support for SolydXK EE is provided by the community.
User avatar
Arjen Balfoort
Site Admin
Posts: 9280
Joined: 26 Jan 2013 19:36
Location: Netherlands
Contact:

Testers needed: new Live Installer

Postby Arjen Balfoort » 07 Oct 2015 20:23

This new Live Installer has several changes.

Some were taken from Mint's Live Installer:
  • A new user picture button.
  • Offline Broadcom dkms installation.
  • Minor graphical improvements
However, the biggest changes were done by yours sincerily:
  • Select the device for Grub installation in the partition overview by means of a selectable check box. This resulted in a complete partition overview: Live Installer checks where Grub was installed to show that in the overview and I could now drop the last "Advanced ontions" screen. Leaving just four screens to configure before installation.
  • Right-click on a partition to select the "Advanced..." menu to encrypt the selected partition. It will ask for your encryption password if there already is an encrypted partition present. The Live Installer does recognize it as being encrypted and can extract the information from it only with that password.
  • Labels can now be written to the partitions.
I've prepared some ISOs with the new Live Installer (and some other updated packages that are not in the repository yet):
http://downloads.solydxk.nl/dev/live-installer/
If that's too much but you still would like to test the new Live Installer on an older ISO you can download the debs here:
http://downloads.solydxk.nl/dev/live-installer/deb
Then boot live and install that deb before running the Live Installer. You cannot test the Broadcom driver installation this way: the needed package is only available on the aforementioned ISOs.

Before you start testing you need to run live-installer from a terminal and save the output when you're done.
Do this in VirtualBox and not on metal! You'll need at least two drives with several partitions each.

Test cases
  1. Grub on /dev/sda, / on /dev/sda1, /home on /dev/sdb1
  2. Grub on /dev/sda, / on /dev/sda1, /home on /dev/sdb1 encrypted
  3. Grub on /dev/sda, / on /dev/sda1 encrypted (this should warn you to mount /boot on a separate, non-encrypted partition), /home on /dev/sdb1 encrypted
  4. Grub on /dev/sdb, / on /dev/sda1, /home on /dev/sdb1
  5. Grub on /dev/sda1, / on /dev/sda1, /home on /dev/sdb1
  6. Grub on /dev/sda1, / on /dev/sda1 encrypted, /home on /dev/sdb1 encrypted
  7. Grub on /dev/sda, / on /dev/sda1, /tmp on /dev/sda2 encrypted, /home on /dev/sdb1 encrypted
  8. Check if swap is detected correctly and written to fstab
  9. Try a multi-boot setup
After installation:
  1. Do not reboot!
  2. Save the entire output from the terminal and post that back here.
  3. Check if the boot flag has been set correctly (on /boot partition if it exists or on / partition):
    sudo fdisk -l
  4. Check disk or partition for "GRUB" in output (e.g.: /dev/sda):

    Code: Select all

    sudo dd bs=512 count=1 if=/dev/sda 2>/dev/null | strings
  5. In the terminal output: check the UUIDs of fstab and crypttab with the output of blkid (above fstab).
  6. fstab: /dev/mapper/sdXY UUIDs
  7. crypttab: /dev/sdXY UUIDs
Broadcom users that need broadcom-sta-dkms:
  • Does broadcom-sta-dkms install?
    Search for "Supported Broadcom deviceid found" in the terminal output.
  • Has the blacklist file been created:

    Code: Select all

    cat /target/etc/modprobe.d/blacklist-broadcom.conf
Shut down, unmount ISO and boot.
Provide the encryption password when asked for.


Found issues
  • [DONE] Grub on partition instead of disk is not listed in the partition overview.
  • [DONE] Grub menu has no background image when root partition is encrypted.
    It's obvious: /boot hasn't been mounted yet. So, it cannot find the background image.
    I don't think I can do something about that.
  • [DONE] Encrypted partition has no color of its own in the graphical overview bar.
  • [DONE] No warnings (and default selections) when selecting for encryption.
  • [DONE] boot flag is not set when switching Grub partition.
  • [DONE] boot flag is not removed when moving boot flag to another disk.
  • [DONE] swap is being listed as "Operating system".
  • [DONE] "Mount as" is not automatically done for existing swap partition.
  • [DONE] Swap partition is not configured in fstab.
  • [DONE] You cannot right-click on a swap partition but you can double-click. Double-click must be disabled.
  • [DONE] Cannot gather information of already encrypted partitions (need to ask for passphrase).
  • [DONE] Already encrypted /home is always being formatted if mounted as /home.
  • [DONE] Already encrypted partition is not being saved correctly in fstab.
  • [DONE] Cannot write label to partition.
  • Can create a fat32 /boot partition but system is not bootable.
  • [DONE] update-grub does not include an already encrypted root system (with separate /boot partition).
  • [DONE/NOT CONFIRMED] When USB is inserted, Live Installer crashes on getFlagAsString(): http://forums.solydxk.nl/viewtopic.php?p=56889#p56889
  • [DONE]Formatting an already encrypted partition to anything but LUKS creates an unbootable system
For reference: encrypt /dev/sda2 and mount it as /home

Code: Select all

su
onenssl enc -aes-256-ctr -pass pass:"$(dd if=/dev/urandom bs=128 count=1 2>/dev/null | base64)" -nosalt < /dev/zero > /dev/sda2
printf "my_passphrase" | cryptsetup luksFormat --cipher aes-xts-plain64 --key-size 512 --hash sha512 --iter-time 5000 --use-random /dev/sda2
printf "my_passphrase" | cryptsetup luksOpen /dev/sda2 sda2
mkfs.ext4 -F -q /dev/mapper/sda2
UUID=$(blkid -o value -s UUID /dev/mapper/sda2)
echo -e "UUID=$UUID\t/home\text4\trw,errors=remount-ro\t0\t1" >> /etc/fstab
UUID=$(blkid -o value -s UUID /dev/sda2)
echo -e "sda2\tUUID=$UUID\tnone\tluks" >> /etc/crypttab
Reboot and you will be asked for your "my_passphrase".
Manual mount of an encrypted partition:

Code: Select all

mkdir /mnt/sda2
cryptsetup luksOpen /dev/sda2 sda2
mount /dev/mapper/sda2 /mnt/sda2
ls /mnt/sda2


SolydXK needs you!
Development | Testing | Translations

User avatar
Arjen Balfoort
Site Admin
Posts: 9280
Joined: 26 Jan 2013 19:36
Location: Netherlands
Contact:

Re: Testers needed: new Live Installer

Postby Arjen Balfoort » 07 Oct 2015 20:28

Just to get this started:

Test 3: OK

Test 6:
Configuration:
live-installer-partitions-t6.png
Terminal output:
live-installer-t6.txt
(16.68 KiB) Downloaded 67 times
I saw that both /dev/sda as /dev/sda1 had Grub installed.
fstab and crontab: OK
Reboot:
error: no such device: b0997cd...0699
Entering rescue mode...
blkid did not list that UUID. So, I removed grub from /dev/sda:

Code: Select all

sudo dd if=/dev/zero of=/dev/sda bs=446 count=1
FATAL: No bootable medium found! System halted.
Did test 6 again, but still the "no bootable medium found" error.
No solution, yet.


SolydXK needs you!
Development | Testing | Translations

ukbrian
Posts: 72
Joined: 01 Mar 2013 04:20

Re: Testers needed: new Live Installer

Postby ukbrian » 08 Oct 2015 08:18

Any chance of using partition labels like the new beta installer on Manjaro?
Attachments
manjaro-installer.png

User avatar
Arjen Balfoort
Site Admin
Posts: 9280
Joined: 26 Jan 2013 19:36
Location: Netherlands
Contact:

Re: Testers needed: new Live Installer

Postby Arjen Balfoort » 08 Oct 2015 08:45

First things first.
This is a testing topic, not a feature request topic.


SolydXK needs you!
Development | Testing | Translations

User avatar
Arjen Balfoort
Site Admin
Posts: 9280
Joined: 26 Jan 2013 19:36
Location: Netherlands
Contact:

Re: Testers needed: new Live Installer

Postby Arjen Balfoort » 08 Oct 2015 08:47

I've successfully completed test 6 with an updated Live Installer.
live-installer-t6.2.txt
(16.94 KiB) Downloaded 67 times
You can get the debs here: http://downloads.solydxk.nl/dev/live-installer/deb
I'm building new ISOs with this Live Installer now. So, that can take a while.


SolydXK needs you!
Development | Testing | Translations

User avatar
grizzler
Posts: 2169
Joined: 04 Mar 2013 15:45
Location: The Hague, NL

Re: Testers needed: new Live Installer

Postby grizzler » 08 Oct 2015 10:26

This is with the SolydX nightly of 23 September and the live-installer debs from the link in the previous message.

After installing the new debs I played with the installer a bit before doing the suggested tests, to see if I could make it crash. I used one of my regular test VMs with a newly created extra vdi. As this was unformatted, I allowed the installer to create a "set of partitions" there. To my surprise, it created a swap partition, apparently ignoring the fact there already was one on the other disk.

I decided to remove these partitons and create a single new one, so I chose Edit partitions and the installer crashed. I expected the error to be reported in the terminal as well, so I didn't make a note of it. However, all the terminal window showed was "Showing ErrorDialog (<b>The installer has failed wi ...)". Not very useful.
Fortunately, the crash was perfectly repeatable, even with a properly formatted disk. See attached zip.

I'll run more tests later this afternoon or evening.
Attachments
li-test.png.zip
(283.25 KiB) Downloaded 77 times
Frank

SolydX EE 64 - tracking Debian Testing

User avatar
Arjen Balfoort
Site Admin
Posts: 9280
Joined: 26 Jan 2013 19:36
Location: Netherlands
Contact:

Re: Testers needed: new Live Installer

Postby Arjen Balfoort » 08 Oct 2015 11:22

I've overwritten the deb files.
Could you try it again, please?


SolydXK needs you!
Development | Testing | Translations

User avatar
grizzler
Posts: 2169
Joined: 04 Mar 2013 15:45
Location: The Hague, NL

Re: Testers needed: new Live Installer

Postby grizzler » 08 Oct 2015 16:12

OK. No more crash after pressing Edit partitions.

So far I've only done the first test, be it with root on sda2 and sda1 as swap. Or rather sda1 should be swap but it isn't because the partition id (which was correct to start with!) gets messed up: it becomes 83 (should be 82). Is that what you meant with 'swap is being listed as "Operating system"'?
Because of this, fstab doesn't list a swap partition either.

There was another oddity: gparted complained about not being able to create a filesystem on sdb1 because it was mounted. Which seems a bit of a contradiction in itself, because sdb started without any partitions. I had removed the partition there to see what would happen if I started the live installer in that state. In spite of this error, running a check on sdb1 showed the partition did have an ext4 filesystem after all, but that could have been left over from the previous test run, before I removed the partition (as far as I know, all 'removing' does is remove the entry from the partition table). I'll try this again with a completely new vdi on a following run (which may be later this evening or tomorrow).

The attached zip contains a screen print of the gparted issue and a text file with the terminal output.
Attachments
li-test-1.zip
(222.67 KiB) Downloaded 68 times
Frank

SolydX EE 64 - tracking Debian Testing

User avatar
grizzler
Posts: 2169
Joined: 04 Mar 2013 15:45
Location: The Hague, NL

Re: Testers needed: new Live Installer

Postby grizzler » 08 Oct 2015 20:14

Second test, again with sda2 as root and sda1 as swap. Encrypted /home on sdb. See attached zip. This time the swap partition did end up in fstab, even though the partition id is still wrong. Odd.

Clean sdb, formatted as one partition using Edit partitions. No issues.
Attachments
li-test-2.zip
(6.88 KiB) Downloaded 71 times
Frank

SolydX EE 64 - tracking Debian Testing

User avatar
grizzler
Posts: 2169
Joined: 04 Mar 2013 15:45
Location: The Hague, NL

Re: Testers needed: new Live Installer

Postby grizzler » 08 Oct 2015 21:08

Test 3: sda1=swap, sda2=/boot, sda3=/ (encrypted), sdb1=/home (encrypted). Installation as expected, result not so much: I see the usual tree square dots that move somewhat slower than usual and then grind to a halt. That's it. No idea what's blocking things, although I have a sneaking suspicion it may be plymouth. I'll try something else tomorrow.
Attachments
li-test-3.zip
(7.13 KiB) Downloaded 71 times
Frank

SolydX EE 64 - tracking Debian Testing

User avatar
grizzler
Posts: 2169
Joined: 04 Mar 2013 15:45
Location: The Hague, NL

Re: Testers needed: new Live Installer

Postby grizzler » 08 Oct 2015 21:43

Schoelje wrote:Grub menu has not background image when root partition is encrypted.
It's obvious: /boot hasn't been mounted yet. So, it cannot find the background image.
I don't think I can do something about that.
Just do as I told you in April 2014: http://forums.solydxk.nl/viewtopic.php?f=79&t=3557 :roll: :lol:
Frank

SolydX EE 64 - tracking Debian Testing

User avatar
Arjen Balfoort
Site Admin
Posts: 9280
Joined: 26 Jan 2013 19:36
Location: Netherlands
Contact:

Re: Testers needed: new Live Installer

Postby Arjen Balfoort » 08 Oct 2015 21:48

I've made some minor changes and I think it handles an existing swap partition correctly now.
I tested by using your previously described configuration and the UUID of the swap partition in fstab was the same as listed by blkid.

The new debs were uploaded.


SolydXK needs you!
Development | Testing | Translations

User avatar
Arjen Balfoort
Site Admin
Posts: 9280
Joined: 26 Jan 2013 19:36
Location: Netherlands
Contact:

Re: Testers needed: new Live Installer

Postby Arjen Balfoort » 08 Oct 2015 21:53

grizzler wrote:
Schoelje wrote:Grub menu has not background image when root partition is encrypted.
It's obvious: /boot hasn't been mounted yet. So, it cannot find the background image.
I don't think I can do something about that.
Just do as I told you in April 2014: http://forums.solydxk.nl/viewtopic.php?f=79&t=3557 :roll: :lol:
I blame age...


SolydXK needs you!
Development | Testing | Translations

User avatar
Arjen Balfoort
Site Admin
Posts: 9280
Joined: 26 Jan 2013 19:36
Location: Netherlands
Contact:

Re: Testers needed: new Live Installer

Postby Arjen Balfoort » 09 Oct 2015 05:53

ISOs updated as well.


SolydXK needs you!
Development | Testing | Translations

User avatar
Arjen Balfoort
Site Admin
Posts: 9280
Joined: 26 Jan 2013 19:36
Location: Netherlands
Contact:

Re: Testers needed: new Live Installer

Postby Arjen Balfoort » 09 Oct 2015 09:12

Successfully completed test 7 on SolydK64.
live-installer-t7.txt
(22.36 KiB) Downloaded 62 times
I changed /etc/grub.d/07_solydxk_theme in solydk-system-adjustments but still there is no Grub background image:

Code: Select all

#!/bin/bash -e

source /usr/lib/grub/grub-mkconfig_lib

cat << EOF
if background_image $prefix/grubbg.png ; then
  set color_normal=white/black
  set color_highlight=dark-gray/white
fi
EOF
I still think this is the price you have to pay for an encrypted root partition.


SolydXK needs you!
Development | Testing | Translations

User avatar
grizzler
Posts: 2169
Joined: 04 Mar 2013 15:45
Location: The Hague, NL

Re: Testers needed: new Live Installer

Postby grizzler » 09 Oct 2015 10:11

Strange. Yesterday I manually changed the grub.cfg file on the last test install to look exactly like that and the background image shows up fine.

However... I also changed the corresponding line in the /etc/grub.d/05_debian_theme section. I just changed that back to what it was originally and the background image disappeared again. So you need to change both (which is odd, because I know I had it working with just the one change last year...).

Also, are you sure the cat command you used here won't try to find $prefix (and fail) while it's creating that piece of code? It needs to write it out as it is (i.e. use \$prefix so the $ doesn't signal the start of a variable).
Frank

SolydX EE 64 - tracking Debian Testing

User avatar
grizzler
Posts: 2169
Joined: 04 Mar 2013 15:45
Location: The Hague, NL

Re: Testers needed: new Live Installer

Postby grizzler » 09 Oct 2015 15:46

Second attempt at test 3. Same parameters as yesterday. Installation seemed to go fine, but still no go after rebooting. I started the ISO with the 'safe' option, so the installation was done without plymouth. The problem appears to be the root filesystem not being decrypted. See attached zip.

I'm not familiar with encrypting filesystems, but what surprised me is there is no way to keep the previous /home directory in case of encryption. Reformatting is enforced. Is that normal? It seems to be in direct conflict with the concept of keeping your /home when you reinstall.

P.S.
I used a small script to run the sequence, hence the output lines starting with ">>>>>>".
Attachments
li-test-3.1.zip
(18.08 KiB) Downloaded 63 times
Frank

SolydX EE 64 - tracking Debian Testing

User avatar
Arjen Balfoort
Site Admin
Posts: 9280
Joined: 26 Jan 2013 19:36
Location: Netherlands
Contact:

Re: Testers needed: new Live Installer

Postby Arjen Balfoort » 09 Oct 2015 15:58

I'll have to look into that: ask the user for a password to mount the encrypted partitions.
That is going to be difficult, though.

I also found that when installing another OS after the installation of an encrypted system to create a dual-boot removes the encrypted system from Grub. After boot I tried to recreate Grub with update-grub but even after mounting the encrypted partitions I still got the same error:

Code: Select all

solydxk@solydxk ~ $ sudo update-grub
Generating grub configuration file ...
Found background image: grubbg.png
Found linux image: /boot/vmlinuz-3.16.0-4-amd64
Found initrd image: /boot/initrd.img-3.16.0-4-amd64
mount: unknown filesystem type 'crypto_LUKS'
mount: unknown filesystem type 'crypto_LUKS'
done


SolydXK needs you!
Development | Testing | Translations

SolydForEver
Posts: 342
Joined: 13 Oct 2014 05:25
Location: East part of The Netherlands

Re: Testers needed: new Live Installer

Postby SolydForEver » 09 Oct 2015 17:15

Did the following test:

Grub on sda
swap on /sda1
/ on sda2
/home on /sdb1

In the attached files the outputs of the installation and the commands after the installation.

User avatar
Arjen Balfoort
Site Admin
Posts: 9280
Joined: 26 Jan 2013 19:36
Location: Netherlands
Contact:

Re: Testers needed: new Live Installer

Postby Arjen Balfoort » 09 Oct 2015 18:53

In the output I see this:

Code: Select all

Executing: chroot /target/ /bin/sh -c "grub-install --force /dev/sda2"
Installing for i386-pc platform.
grub-install: warning: File system `ext2' doesn't support embedding.
grub-install: warning: Embedding is not possible.  GRUB can only be installed in this setup by using blocklists.  However, blocklists are UNRELIABLE and their use is discouraged..
Installation finished. No error reported.
This means that you chose to install grub on sda2 (a partition) and not on sda (the disk).
Were you able to boot the system after the installation?


SolydXK needs you!
Development | Testing | Translations


Return to “Testing Zone”

Who is online

Users browsing this forum: No registered users and 2 guests