Community ISO maintenance and build issues - 2

SolydXK is too quiet for you? SolydXK Enthusiast Editions, based on Debian Testing is for you! Here you can find news about Debian Testing and Unstable too, and also tests on SolydXK programs.
The support for SolydXK EE is provided by the community.
User avatar
grizzler
Posts: 2046
Joined: 04 Mar 2013 15:45
Location: The Hague, NL

Community ISO maintenance and build issues - 2

Postby grizzler » 01 Sep 2017 17:29

This thread is meant as a central repository for all issues to do with maintaining and building the Community ISOs. It should be mainly about the 32-bit main ISOs and the EE ISOs, but any other ISO that is only supported by the community may show up here as well. The reason for creating this is twofold: to list problems in the hope of getting some support from the community and to mention changes that may eventually be relevant when the current Testing becomes Stable.
The previous incarnation of this thread is here: viewtopic.php?f=78&t=5961

The text of this first posting will change all the time. It functions as an index and contains a short description of each issue, which may be expanded upon in further postings. Any conclusions/results will also be mentioned here.

Issues

Entries in cyan (actually, color #00BF80...) are closed/solved, but left in the list for reference. Closed entries with a red title/subject line may still be relevant after the current testing becomes stable.

<nothing so far...>
Frank

SolydX EE 64 - tracking Debian Testing

User avatar
ilu
Posts: 2073
Joined: 09 Oct 2013 12:45

Re: Community ISO maintenance and build issues - 2

Postby ilu » 16 Oct 2017 14:43

1. I just installed solydxee1709 and noticed that no directories were created under /media - as a result the users can't mount anything with user perms.

2. Removable USB media does not show up on the desktop or in thunar although the thunar-volman setup is ok. How could I debug this?

3. The tmpfs issue for /var we discussed elsewhere should at least get fixed in the EE. EE should have logs and even if I set a dedicated /var in the installer setup the tmpfs for /var still gets created and seems to take precedence. So apt gets confused because there are 2x /var/apt/cache and errors out. Come to think of it - wouldn't that be a bug in the installer?

User avatar
grizzler
Posts: 2046
Joined: 04 Mar 2013 15:45
Location: The Hague, NL

Re: Community ISO maintenance and build issues - 2

Postby grizzler » 16 Oct 2017 18:02

Both 1 and 3 look like installer issues to me.

About 2: does the kernel recognise the item in question? What do the logs show when it's plugged in?
Frank

SolydX EE 64 - tracking Debian Testing

User avatar
ilu
Posts: 2073
Joined: 09 Oct 2013 12:45

Re: Community ISO maintenance and build issues - 2

Postby ilu » 16 Oct 2017 18:42

1. An install of SolydX1709 created the directories. They are only missing in SolydXEE.

2. Looks like it does:

Code: Select all

dmesg | grep USB
....
[ 3626.617146] usb 1-5: new high-speed USB device number 3 using xhci_hcd
[ 3626.817453] usb 1-5: New USB device found, idVendor=04e8, idProduct=1a23
[ 3626.817456] usb 1-5: New USB device strings: Mfr=1, Product=2, SerialNumber=3
[ 3626.821523] usb-storage 1-5:1.0: USB Mass Storage device detected
Gparted sees the device to but mounting is grey. But I can mount manually in Terminal.

3. Agreed

4. Repo issue: The virtualbox repo doesn't load.

Code: Select all

apt update
...
Ign:11 http://download.virtualbox.org/virtualbox/debian testing InRelease      
OK:12 http://repository.solydxk.com solydxk-ee InRelease
...
Fehl:13 http://download.virtualbox.org/virtualbox/debian testing Release
  404  Not Found [IP: 2.16.4.176 80]
....
E: The repository 'http://download.virtualbox.org/virtualbox/debian testing Release' does not have a Release file.
N: Updating from such a repository can't be done securely, and is therefore disabled by default.
N: See apt-secure(8) manpage for repository creation and user configuration details.

User avatar
ilu
Posts: 2073
Joined: 09 Oct 2013 12:45

Re: Community ISO maintenance and build issues - 2

Postby ilu » 17 Oct 2017 05:05

1. + 2. I installed gvfs-fuse and now the mounting works. First mount operation created the necessary directory. gvfs-fuse should be added to the ISO.

Still no idea about no. 4.

kurotsugi
Posts: 2121
Joined: 09 Jan 2014 00:17

Re: Community ISO maintenance and build issues - 2

Postby kurotsugi » 17 Oct 2017 06:28

3. the tmpfs other than the kernel directories are manually created. you might still have some remnants on your /fstab.
4. the repo didn't exist. stretch and jessie did exist, but no testing or sid available.

User avatar
ilu
Posts: 2073
Joined: 09 Oct 2013 12:45

Re: Community ISO maintenance and build issues - 2

Postby ilu » 17 Oct 2017 12:38

3. I'll post a bug report for the installer. (There were no remnants, it's a fresh install.)

4. There's a vb package for buster (https://packages.debian.org/buster/virtualbox) - why do we need the external repo? There's also a backported version for stretch, so also on stable there should be no need for the virtualbox repo?

User avatar
grizzler
Posts: 2046
Joined: 04 Mar 2013 15:45
Location: The Hague, NL

Re: Community ISO maintenance and build issues - 2

Postby grizzler » 17 Oct 2017 18:19

The package gvfs-fuse is in the ISO's package list. Apparently something is removing it after installation. Need to find out what...

What's creating the virtualbox repo line? The Welcome application? I still haven't found the time to check its scripts for incompatibilities, I'm afraid. I know there are several. Wasn't expecting this one, though.

Why not use the Debian virtualbox package? Because it will only exist as long as buster is testing. Unless either Debian or Oracle makes a drastic policy change, there will never be a virtualbox package in a stable release again (backports doesn't count). So we might as well use the same source for the EEs.
Frank

SolydX EE 64 - tracking Debian Testing

User avatar
ilu
Posts: 2073
Joined: 09 Oct 2013 12:45

Re: Community ISO maintenance and build issues - 2

Postby ilu » 17 Oct 2017 19:59

grizzler wrote:What's creating the virtualbox repo line? The Welcome application?
Yeah, probably - I used that. The code in solydxk-welcome/usr/lib/solydxk/welcome/scripts/system is:

Code: Select all

# Add virtualbox to sources
REL=$(grep '/debian' /etc/apt/sources.list | grep -v backports | awk '{print $3}')
if [ "$REL" != '' ]; then
  wget -q https://www.virtualbox.org/download/oracle_vbox_2016.asc -O- | apt-key add -
  wget -q https://www.virtualbox.org/download/oracle_vbox.asc -O- | apt-key add -
  echo "deb http://download.virtualbox.org/virtualbox/debian $REL contrib" > /etc/apt/sources.list.d/virtualbox.list
fi
grizzler wrote:The package gvfs-fuse is in the ISO's package list. Apparently something is removing it after installation. Need to find out what...
If the directories are created when first used (and not during install) that might be possible. I'll check the logs.

User avatar
Arjen Balfoort
Site Admin
Posts: 8887
Joined: 26 Jan 2013 19:36
Location: Netherlands
Contact:

Re: Community ISO maintenance and build issues - 2

Postby Arjen Balfoort » 18 Oct 2017 06:58

I've updated live-installer-3 (commented /var/log/* entries in fstab for SSD systems) and solydxk-welcome (only use virtualbox repository for Stretch) for solydxk-10.
I haven't tested them on the EEs, though.


SolydXK needs you!
Development | Testing | Translations

User avatar
grizzler
Posts: 2046
Joined: 04 Mar 2013 15:45
Location: The Hague, NL

Re: Community ISO maintenance and build issues - 2

Postby grizzler » 06 Jul 2018 13:45

Updating the EE ISOs caused a complete meltdown of the first one (SolydK EE 32), probably because of some essential package which is no longer available in Testing. Even the live installer was removed.


Arjen,
I intend to provide the missing packages separately (pulling them from unstable or the snapshot repo), but the live installer will remove them anyway (won't it?), making installing the EEs impossible. We need some way to tell the live installer to forget about removing (some) unavailable packages...
By the way, we're not talking about one or two packages here... :(

I'm thinking about creating a list of packages in boot/live/ on the ISO, called filesystem.packages-keep or something like that. The installer should not try to remove any package in that list.
Frank

SolydX EE 64 - tracking Debian Testing

User avatar
Arjen Balfoort
Site Admin
Posts: 8887
Joined: 26 Jan 2013 19:36
Location: Netherlands
Contact:

Re: Community ISO maintenance and build issues - 2

Postby Arjen Balfoort » 06 Jul 2018 15:19

Only solydxk-constructor would remove unavailable packages when building an ISO. There is no code in the live-installer to do that.

I see that live-installer creates a cleanup.sh script at the end of the process:
#!/bin/bash
sed -i 's/^deb cdrom/#deb cdrom/' /etc/apt/sources.list
dpkg --configure -a
apt-get install -f
apt-get clean
apt-get autoremove
while [ "$(deborphan)" ]; do
apt-get purge $(deborphan)
done


SolydXK needs you!
Development | Testing | Translations

User avatar
grizzler
Posts: 2046
Joined: 04 Mar 2013 15:45
Location: The Hague, NL

Re: Community ISO maintenance and build issues - 2

Postby grizzler » 06 Jul 2018 16:31

Right. In that case just putting the removed packages back should work.

I was sure the installer did some clean up near the end (remember seeing it in a terminal install session once). Could have been orphaned packages rather than unavailable ones, I guess.
Frank

SolydX EE 64 - tracking Debian Testing

User avatar
grizzler
Posts: 2046
Joined: 04 Mar 2013 15:45
Location: The Hague, NL

Re: Community ISO maintenance and build issues - 2

Postby grizzler » 08 Jul 2018 10:46

Well, that was a waste of time...

Turns out the only package that really mattered was geoip-database-contrib. The installer needs that but it's gone. Replaced with - wait for it - geoip-database!

I don't know if this has the same API as the dead one, i.e. updating the installer may require more than simply changing a Depends: line. I think that might be enough, though, as python3-geoip never even had geoip-database-contrib as dependency (wtf?).
Frank

SolydX EE 64 - tracking Debian Testing

User avatar
grizzler
Posts: 2046
Joined: 04 Mar 2013 15:45
Location: The Hague, NL

Re: Community ISO maintenance and build issues - 2

Postby grizzler » 08 Jul 2018 19:21

More EE issues: VirtualBox. Current version in testing fails to build guest additions video module and latest in unstable fails to run at all. Nice.

I suppose I could pull the last 5.2.12 from snapshot (has a fix for the first issue and doesn't have the second one yet...). Has anyone used 5.2.12-dfsg-3 without issues for any length of time? It's been the latest in unstable for a couple of weeks.
Frank

SolydX EE 64 - tracking Debian Testing

kurotsugi
Posts: 2121
Joined: 09 Jan 2014 00:17

Re: Community ISO maintenance and build issues - 2

Postby kurotsugi » 09 Jul 2018 05:49

unfortunately, our forums is lacking from those adventurous spirit. sadly, that including me :oops:
got a new job and haven't touch sid since then. well...the repo is active on the list but it's blocked by apt-pinning. I'm not sure if anyone here except you still using sid.

anyway, goodluck.

User avatar
Arjen Balfoort
Site Admin
Posts: 8887
Joined: 26 Jan 2013 19:36
Location: Netherlands
Contact:

Re: Community ISO maintenance and build issues - 2

Postby Arjen Balfoort » 09 Jul 2018 07:12

grizzler wrote:
08 Jul 2018 10:46
Well, that was a waste of time...

Turns out the only package that really mattered was geoip-database-contrib. The installer needs that but it's gone. Replaced with - wait for it - geoip-database!

I don't know if this has the same API as the dead one, i.e. updating the installer may require more than simply changing a Depends: line. I think that might be enough, though, as python3-geoip never even had geoip-database-contrib as dependency (wtf?).
So, if I change the geoip line in the controls file of live-installer-3 to this:

Code: Select all

geoip-database-contrib | geoip-database
It'll help you?


SolydXK needs you!
Development | Testing | Translations

User avatar
grizzler
Posts: 2046
Joined: 04 Mar 2013 15:45
Location: The Hague, NL

Re: Community ISO maintenance and build issues - 2

Postby grizzler » 09 Jul 2018 10:28

It would, but why bother using geoip-database-contrib at all? The geoip-database package has been around for years. It's available in stretch, even goes back as far as wheezy.
Frank

SolydX EE 64 - tracking Debian Testing

User avatar
grizzler
Posts: 2046
Joined: 04 Mar 2013 15:45
Location: The Hague, NL

Re: Community ISO maintenance and build issues - 2

Postby grizzler » 09 Jul 2018 10:32

kurotsugi wrote:
09 Jul 2018 05:49
unfortunately, our forums is lacking from those adventurous spirit. sadly, that including me :oops:
Darned... :lol:
anyway, goodluck.
Thanks. I think I'll wait a little longer. Maybe the issue with the current latest in sid is fixed soon... :roll:
Frank

SolydX EE 64 - tracking Debian Testing

User avatar
Arjen Balfoort
Site Admin
Posts: 8887
Joined: 26 Jan 2013 19:36
Location: Netherlands
Contact:

Re: Community ISO maintenance and build issues - 2

Postby Arjen Balfoort » 09 Jul 2018 11:42

grizzler wrote:
09 Jul 2018 10:28
It would, but why bother using geoip-database-contrib at all? The geoip-database package has been around for years. It's available in stretch, even goes back as far as wheezy.
Because geoip-database-contrib is a download script:
This package contains a script that downloads the latest version of the binary flavor of the four MaxMind GeoLite databases (Country, IPv6 Country, City, and ASN).
https://packages.debian.org/jessie/geoi ... se-contrib

While geoip-database just contains a (static) database:
This package contains the free GeoLiteCountry database.
https://packages.debian.org/jessie/geoip-database

Perhaps for the installer it's overkill to have the contrib package.


SolydXK needs you!
Development | Testing | Translations


Return to “Testing zone”

Who is online

Users browsing this forum: Google [Bot] and 3 guests