* [PATCH] fetch/git: add support for disabling shared clones on unpack
@ 2017-12-12 14:44 Henning Schild
2017-12-12 14:49 ` Henning Schild
` (3 more replies)
0 siblings, 4 replies; 10+ messages in thread
From: Henning Schild @ 2017-12-12 14:44 UTC (permalink / raw)
To: bitbake-devel; +Cc: isar-users, Henning Schild
By default the unpacker will create a "shared" clone when cloning from
the DL_DIR to the WORKDIR. This patch introduces an option to control
that behaviour. Probably something that hardly anyone would want to do.
Imagine some recipe steps are executed in a namespace that is different
from the one your downloader and unpacker ran in. (chroot) Because a
"shared" clone has an absolute reference to its "alternate" you now
have to make that "alternate" visible in that new namespace (chroot) at
the exact place.
With this patch you can unpack "noshared" and get a stand-alone copy.
This copy will also work if the "alternate" is not visible or existant.
Signed-off-by: Henning Schild <henning.schild@siemens.com>
---
lib/bb/fetch2/git.py | 13 ++++++++++++-
1 file changed, 12 insertions(+), 1 deletion(-)
diff --git a/lib/bb/fetch2/git.py b/lib/bb/fetch2/git.py
index 5ef8cd69..30b88c83 100644
--- a/lib/bb/fetch2/git.py
+++ b/lib/bb/fetch2/git.py
@@ -53,6 +53,13 @@ Supported SRC_URI options are:
For local git:// urls to use the current branch HEAD as the revision for use with
AUTOREV. Implies nobranch.
+- noshared
+ When unpacking do not clone with the parameter "--shared". This option will
+ allow the unpacked copy to work stand-alone i.e. if your recipe runs in a
+ chroot where the "alternate" can not be found. Setting this will increase
+ the unpack-time and the disk-usage.
+ The default is "0", set noshared=1 if needed.
+
"""
#Copyright (C) 2005 Richard Purdie
@@ -159,6 +166,8 @@ class Git(FetchMethod):
ud.nobranch = ud.parm.get("nobranch","0") == "1"
+ ud.noshared = ud.parm.get("noshared","0") == "1"
+
# usehead implies nobranch
ud.usehead = ud.parm.get("usehead","0") == "1"
if ud.usehead:
@@ -176,7 +185,9 @@ class Git(FetchMethod):
if len(branches) != len(ud.names):
raise bb.fetch2.ParameterError("The number of name and branch parameters is not balanced", ud.url)
- ud.cloneflags = "-s -n"
+ cloneflags = "-n"
+ if not ud.noshared:
+ cloneflags += " -s"
if ud.bareclone:
ud.cloneflags += " --mirror"
--
2.13.6
^ permalink raw reply [flat|nested] 10+ messages in thread
* Re: [PATCH] fetch/git: add support for disabling shared clones on unpack
2017-12-12 14:44 [PATCH] fetch/git: add support for disabling shared clones on unpack Henning Schild
@ 2017-12-12 14:49 ` Henning Schild
2017-12-12 15:01 ` Henning Schild
` (2 subsequent siblings)
3 siblings, 0 replies; 10+ messages in thread
From: Henning Schild @ 2017-12-12 14:49 UTC (permalink / raw)
To: bitbake-devel; +Cc: isar-users
We actually ran into that issue on a build system called Isar.
https://github.com/ilbers/isar
This build system executes some tasks in a chroot. In this chroot a
"shared" clone will not work because it expects its "alternate" to be
at the very same location it was outside the chroot. We considered
several hacks in Isar
- patching the alternates before and after chroot
- mounting the "alternate" to the exact location in chroot
None of this is really nice, so we decided to try and do something
about it upstream.
regards,
Henning
Am Tue, 12 Dec 2017 15:44:43 +0100
schrieb Henning Schild <henning.schild@siemens.com>:
> By default the unpacker will create a "shared" clone when cloning from
> the DL_DIR to the WORKDIR. This patch introduces an option to control
> that behaviour. Probably something that hardly anyone would want to
> do.
>
> Imagine some recipe steps are executed in a namespace that is
> different from the one your downloader and unpacker ran in. (chroot)
> Because a "shared" clone has an absolute reference to its "alternate"
> you now have to make that "alternate" visible in that new namespace
> (chroot) at the exact place.
>
> With this patch you can unpack "noshared" and get a stand-alone copy.
> This copy will also work if the "alternate" is not visible or
> existant.
>
> Signed-off-by: Henning Schild <henning.schild@siemens.com>
> ---
> lib/bb/fetch2/git.py | 13 ++++++++++++-
> 1 file changed, 12 insertions(+), 1 deletion(-)
>
> diff --git a/lib/bb/fetch2/git.py b/lib/bb/fetch2/git.py
> index 5ef8cd69..30b88c83 100644
> --- a/lib/bb/fetch2/git.py
> +++ b/lib/bb/fetch2/git.py
> @@ -53,6 +53,13 @@ Supported SRC_URI options are:
> For local git:// urls to use the current branch HEAD as the
> revision for use with AUTOREV. Implies nobranch.
>
> +- noshared
> + When unpacking do not clone with the parameter "--shared". This
> option will
> + allow the unpacked copy to work stand-alone i.e. if your recipe
> runs in a
> + chroot where the "alternate" can not be found. Setting this will
> increase
> + the unpack-time and the disk-usage.
> + The default is "0", set noshared=1 if needed.
> +
> """
>
> #Copyright (C) 2005 Richard Purdie
> @@ -159,6 +166,8 @@ class Git(FetchMethod):
>
> ud.nobranch = ud.parm.get("nobranch","0") == "1"
>
> + ud.noshared = ud.parm.get("noshared","0") == "1"
> +
> # usehead implies nobranch
> ud.usehead = ud.parm.get("usehead","0") == "1"
> if ud.usehead:
> @@ -176,7 +185,9 @@ class Git(FetchMethod):
> if len(branches) != len(ud.names):
> raise bb.fetch2.ParameterError("The number of name and
> branch parameters is not balanced", ud.url)
> - ud.cloneflags = "-s -n"
> + cloneflags = "-n"
> + if not ud.noshared:
> + cloneflags += " -s"
> if ud.bareclone:
> ud.cloneflags += " --mirror"
>
^ permalink raw reply [flat|nested] 10+ messages in thread
* Re: [PATCH] fetch/git: add support for disabling shared clones on unpack
2017-12-12 14:44 [PATCH] fetch/git: add support for disabling shared clones on unpack Henning Schild
2017-12-12 14:49 ` Henning Schild
@ 2017-12-12 15:01 ` Henning Schild
2017-12-12 15:12 ` [PATCH v2] " Henning Schild
2017-12-12 15:14 ` [PATCH] " Henning Schild
3 siblings, 0 replies; 10+ messages in thread
From: Henning Schild @ 2017-12-12 15:01 UTC (permalink / raw)
To: isar-users; +Cc: Christian Storm, Alexander Smirnov
Let us see what upsteam thinks about that patch. If they accept it we
could probably cherry-pick the commit down into our copy of bitbake.
Henning
Am Tue, 12 Dec 2017 15:44:43 +0100
schrieb Henning Schild <henning.schild@siemens.com>:
> By default the unpacker will create a "shared" clone when cloning from
> the DL_DIR to the WORKDIR. This patch introduces an option to control
> that behaviour. Probably something that hardly anyone would want to
> do.
>
> Imagine some recipe steps are executed in a namespace that is
> different from the one your downloader and unpacker ran in. (chroot)
> Because a "shared" clone has an absolute reference to its "alternate"
> you now have to make that "alternate" visible in that new namespace
> (chroot) at the exact place.
>
> With this patch you can unpack "noshared" and get a stand-alone copy.
> This copy will also work if the "alternate" is not visible or
> existant.
>
> Signed-off-by: Henning Schild <henning.schild@siemens.com>
> ---
> lib/bb/fetch2/git.py | 13 ++++++++++++-
> 1 file changed, 12 insertions(+), 1 deletion(-)
>
> diff --git a/lib/bb/fetch2/git.py b/lib/bb/fetch2/git.py
> index 5ef8cd69..30b88c83 100644
> --- a/lib/bb/fetch2/git.py
> +++ b/lib/bb/fetch2/git.py
> @@ -53,6 +53,13 @@ Supported SRC_URI options are:
> For local git:// urls to use the current branch HEAD as the
> revision for use with AUTOREV. Implies nobranch.
>
> +- noshared
> + When unpacking do not clone with the parameter "--shared". This
> option will
> + allow the unpacked copy to work stand-alone i.e. if your recipe
> runs in a
> + chroot where the "alternate" can not be found. Setting this will
> increase
> + the unpack-time and the disk-usage.
> + The default is "0", set noshared=1 if needed.
> +
> """
>
> #Copyright (C) 2005 Richard Purdie
> @@ -159,6 +166,8 @@ class Git(FetchMethod):
>
> ud.nobranch = ud.parm.get("nobranch","0") == "1"
>
> + ud.noshared = ud.parm.get("noshared","0") == "1"
> +
> # usehead implies nobranch
> ud.usehead = ud.parm.get("usehead","0") == "1"
> if ud.usehead:
> @@ -176,7 +185,9 @@ class Git(FetchMethod):
> if len(branches) != len(ud.names):
> raise bb.fetch2.ParameterError("The number of name and
> branch parameters is not balanced", ud.url)
> - ud.cloneflags = "-s -n"
> + cloneflags = "-n"
> + if not ud.noshared:
> + cloneflags += " -s"
> if ud.bareclone:
> ud.cloneflags += " --mirror"
>
^ permalink raw reply [flat|nested] 10+ messages in thread
* [PATCH v2] fetch/git: add support for disabling shared clones on unpack
2017-12-12 14:44 [PATCH] fetch/git: add support for disabling shared clones on unpack Henning Schild
2017-12-12 14:49 ` Henning Schild
2017-12-12 15:01 ` Henning Schild
@ 2017-12-12 15:12 ` Henning Schild
2018-02-12 7:40 ` Jan Kiszka
2017-12-12 15:14 ` [PATCH] " Henning Schild
3 siblings, 1 reply; 10+ messages in thread
From: Henning Schild @ 2017-12-12 15:12 UTC (permalink / raw)
To: bitbake-devel; +Cc: isar-users, Henning Schild
By default the unpacker will create a "shared" clone when cloning from
the DL_DIR to the WORKDIR. This patch introduces an option to control
that behaviour. Probably something that hardly anyone would want to do.
Imagine some recipe steps are executed in a namespace that is different
from the one your downloader and unpacker ran in. (chroot) Because a
"shared" clone has an absolute reference to its "alternate" you now
have to make that "alternate" visible in that new namespace (chroot) at
the exact place.
With this patch you can unpack "noshared" and get a stand-alone copy.
This copy will also work if the "alternate" is not visible or existant.
Signed-off-by: Henning Schild <henning.schild@siemens.com>
---
lib/bb/fetch2/git.py | 13 ++++++++++++-
1 file changed, 12 insertions(+), 1 deletion(-)
diff --git a/lib/bb/fetch2/git.py b/lib/bb/fetch2/git.py
index 5ef8cd69..7b7f02b2 100644
--- a/lib/bb/fetch2/git.py
+++ b/lib/bb/fetch2/git.py
@@ -53,6 +53,13 @@ Supported SRC_URI options are:
For local git:// urls to use the current branch HEAD as the revision for use with
AUTOREV. Implies nobranch.
+- noshared
+ When unpacking do not clone with the parameter "--shared". This option will
+ allow the unpacked copy to work stand-alone i.e. if your recipe runs in a
+ chroot where the "alternate" can not be found. Setting this will increase
+ the unpack-time and the disk-usage.
+ The default is "0", set noshared=1 if needed.
+
"""
#Copyright (C) 2005 Richard Purdie
@@ -159,6 +166,8 @@ class Git(FetchMethod):
ud.nobranch = ud.parm.get("nobranch","0") == "1"
+ ud.noshared = ud.parm.get("noshared","0") == "1"
+
# usehead implies nobranch
ud.usehead = ud.parm.get("usehead","0") == "1"
if ud.usehead:
@@ -176,7 +185,9 @@ class Git(FetchMethod):
if len(branches) != len(ud.names):
raise bb.fetch2.ParameterError("The number of name and branch parameters is not balanced", ud.url)
- ud.cloneflags = "-s -n"
+ ud.cloneflags = "-n"
+ if not ud.noshared:
+ ud.cloneflags += " -s"
if ud.bareclone:
ud.cloneflags += " --mirror"
--
2.13.6
^ permalink raw reply [flat|nested] 10+ messages in thread
* Re: [PATCH] fetch/git: add support for disabling shared clones on unpack
2017-12-12 14:44 [PATCH] fetch/git: add support for disabling shared clones on unpack Henning Schild
` (2 preceding siblings ...)
2017-12-12 15:12 ` [PATCH v2] " Henning Schild
@ 2017-12-12 15:14 ` Henning Schild
3 siblings, 0 replies; 10+ messages in thread
From: Henning Schild @ 2017-12-12 15:14 UTC (permalink / raw)
To: bitbake-devel; +Cc: isar-users
Am Tue, 12 Dec 2017 15:44:43 +0100
schrieb Henning Schild <henning.schild@siemens.com>:
> By default the unpacker will create a "shared" clone when cloning from
> the DL_DIR to the WORKDIR. This patch introduces an option to control
> that behaviour. Probably something that hardly anyone would want to
> do.
>
> Imagine some recipe steps are executed in a namespace that is
> different from the one your downloader and unpacker ran in. (chroot)
> Because a "shared" clone has an absolute reference to its "alternate"
> you now have to make that "alternate" visible in that new namespace
> (chroot) at the exact place.
>
> With this patch you can unpack "noshared" and get a stand-alone copy.
> This copy will also work if the "alternate" is not visible or
> existant.
>
> Signed-off-by: Henning Schild <henning.schild@siemens.com>
> ---
> lib/bb/fetch2/git.py | 13 ++++++++++++-
> 1 file changed, 12 insertions(+), 1 deletion(-)
>
> diff --git a/lib/bb/fetch2/git.py b/lib/bb/fetch2/git.py
> index 5ef8cd69..30b88c83 100644
> --- a/lib/bb/fetch2/git.py
> +++ b/lib/bb/fetch2/git.py
> @@ -53,6 +53,13 @@ Supported SRC_URI options are:
> For local git:// urls to use the current branch HEAD as the
> revision for use with AUTOREV. Implies nobranch.
>
> +- noshared
> + When unpacking do not clone with the parameter "--shared". This
> option will
> + allow the unpacked copy to work stand-alone i.e. if your recipe
> runs in a
> + chroot where the "alternate" can not be found. Setting this will
> increase
> + the unpack-time and the disk-usage.
> + The default is "0", set noshared=1 if needed.
> +
> """
>
> #Copyright (C) 2005 Richard Purdie
> @@ -159,6 +166,8 @@ class Git(FetchMethod):
>
> ud.nobranch = ud.parm.get("nobranch","0") == "1"
>
> + ud.noshared = ud.parm.get("noshared","0") == "1"
> +
> # usehead implies nobranch
> ud.usehead = ud.parm.get("usehead","0") == "1"
> if ud.usehead:
> @@ -176,7 +185,9 @@ class Git(FetchMethod):
> if len(branches) != len(ud.names):
> raise bb.fetch2.ParameterError("The number of name and
> branch parameters is not balanced", ud.url)
> - ud.cloneflags = "-s -n"
> + cloneflags = "-n"
> + if not ud.noshared:
> + cloneflags += " -s"
Rebase-mistake, forgot the "ud." before cloneflags. v2 is on the way
Henning
> if ud.bareclone:
> ud.cloneflags += " --mirror"
>
^ permalink raw reply [flat|nested] 10+ messages in thread
* Re: [PATCH v2] fetch/git: add support for disabling shared clones on unpack
2017-12-12 15:12 ` [PATCH v2] " Henning Schild
@ 2018-02-12 7:40 ` Jan Kiszka
0 siblings, 0 replies; 10+ messages in thread
From: Jan Kiszka @ 2018-02-12 7:40 UTC (permalink / raw)
To: [ext] Henning Schild, bitbake-devel; +Cc: isar-users
On 2017-12-12 16:12, [ext] Henning Schild wrote:
> By default the unpacker will create a "shared" clone when cloning from
> the DL_DIR to the WORKDIR. This patch introduces an option to control
> that behaviour. Probably something that hardly anyone would want to do.
>
> Imagine some recipe steps are executed in a namespace that is different
> from the one your downloader and unpacker ran in. (chroot) Because a
> "shared" clone has an absolute reference to its "alternate" you now
> have to make that "alternate" visible in that new namespace (chroot) at
> the exact place.
>
> With this patch you can unpack "noshared" and get a stand-alone copy.
> This copy will also work if the "alternate" is not visible or existant.
s/existant/existent/
>
> Signed-off-by: Henning Schild <henning.schild@siemens.com>
> ---
> lib/bb/fetch2/git.py | 13 ++++++++++++-
> 1 file changed, 12 insertions(+), 1 deletion(-)
>
> diff --git a/lib/bb/fetch2/git.py b/lib/bb/fetch2/git.py
> index 5ef8cd69..7b7f02b2 100644
> --- a/lib/bb/fetch2/git.py
> +++ b/lib/bb/fetch2/git.py
> @@ -53,6 +53,13 @@ Supported SRC_URI options are:
> For local git:// urls to use the current branch HEAD as the revision for use with
> AUTOREV. Implies nobranch.
>
> +- noshared
> + When unpacking do not clone with the parameter "--shared". This option will
> + allow the unpacked copy to work stand-alone i.e. if your recipe runs in a
> + chroot where the "alternate" can not be found. Setting this will increase
> + the unpack-time and the disk-usage.
> + The default is "0", set noshared=1 if needed.
> +
> """
>
> #Copyright (C) 2005 Richard Purdie
> @@ -159,6 +166,8 @@ class Git(FetchMethod):
>
> ud.nobranch = ud.parm.get("nobranch","0") == "1"
>
> + ud.noshared = ud.parm.get("noshared","0") == "1"
> +
> # usehead implies nobranch
> ud.usehead = ud.parm.get("usehead","0") == "1"
> if ud.usehead:
> @@ -176,7 +185,9 @@ class Git(FetchMethod):
> if len(branches) != len(ud.names):
> raise bb.fetch2.ParameterError("The number of name and branch parameters is not balanced", ud.url)
>
> - ud.cloneflags = "-s -n"
> + ud.cloneflags = "-n"
> + if not ud.noshared:
> + ud.cloneflags += " -s"
> if ud.bareclone:
> ud.cloneflags += " --mirror"
>
>
Ping on this feature: Could we get some feedback if/how such a
configuration option would be acceptable for upstream? We'd like to
avoid having to patch or fork bitbake downstream for such a tiny change.
Thanks,
Jan
--
Siemens AG, Corporate Technology, CT RDA IOT SES-DE
Corporate Competence Center Embedded Linux
^ permalink raw reply [flat|nested] 10+ messages in thread
* Re: [PATCH] fetch/git: add support for disabling shared clones on unpack
2017-12-20 16:45 ` Henning Schild
@ 2018-01-30 12:18 ` Henning Schild
0 siblings, 0 replies; 10+ messages in thread
From: Henning Schild @ 2018-01-30 12:18 UTC (permalink / raw)
To: bitbake-devel, Richard Purdie; +Cc: isar-users
Bump! Could i please get a review on this patch?
regards,
Henning
Am Wed, 20 Dec 2017 17:45:38 +0100
schrieb Henning Schild <henning.schild@siemens.com>:
> We actually ran into that issue on a build system called Isar.
>
> https://github.com/ilbers/isar
>
> This build system executes some tasks in a chroot. In this chroot a
> "shared" clone will not work because it expects its "alternate" to be
> at the very same location it was outside the chroot. We considered
> several hacks in Isar
> - patching the alternates before and after chroot
> - mounting the "alternate" to the exact location in chroot
> None of this is really nice, so we decided to try and do something
> about it upstream.
>
> regards,
> Henning
>
> Am Wed, 20 Dec 2017 17:42:09 +0100
> schrieb Henning Schild <henning.schild@siemens.com>:
>
> > By default the unpacker will create a "shared" clone when cloning
> > from the DL_DIR to the WORKDIR. This patch introduces an option to
> > control that behaviour. Probably something that hardly anyone would
> > want to do.
> >
> > Imagine some recipe steps are executed in a namespace that is
> > different from the one your downloader and unpacker ran in. (chroot)
> > Because a "shared" clone has an absolute reference to its
> > "alternate" you now have to make that "alternate" visible in that
> > new namespace (chroot) at the exact place.
> >
> > With this patch you can unpack "noshared" and get a stand-alone
> > copy. This copy will also work if the "alternate" is not visible or
> > existant.
> >
> > Signed-off-by: Henning Schild <henning.schild@siemens.com>
> > ---
> > lib/bb/fetch2/git.py | 13 ++++++++++++-
> > 1 file changed, 12 insertions(+), 1 deletion(-)
> >
> > diff --git a/lib/bb/fetch2/git.py b/lib/bb/fetch2/git.py
> > index 5ef8cd69..7b7f02b2 100644
> > --- a/lib/bb/fetch2/git.py
> > +++ b/lib/bb/fetch2/git.py
> > @@ -53,6 +53,13 @@ Supported SRC_URI options are:
> > For local git:// urls to use the current branch HEAD as the
> > revision for use with AUTOREV. Implies nobranch.
> >
> > +- noshared
> > + When unpacking do not clone with the parameter "--shared". This
> > option will
> > + allow the unpacked copy to work stand-alone i.e. if your recipe
> > runs in a
> > + chroot where the "alternate" can not be found. Setting this will
> > increase
> > + the unpack-time and the disk-usage.
> > + The default is "0", set noshared=1 if needed.
> > +
> > """
> >
> > #Copyright (C) 2005 Richard Purdie
> > @@ -159,6 +166,8 @@ class Git(FetchMethod):
> >
> > ud.nobranch = ud.parm.get("nobranch","0") == "1"
> >
> > + ud.noshared = ud.parm.get("noshared","0") == "1"
> > +
> > # usehead implies nobranch
> > ud.usehead = ud.parm.get("usehead","0") == "1"
> > if ud.usehead:
> > @@ -176,7 +185,9 @@ class Git(FetchMethod):
> > if len(branches) != len(ud.names):
> > raise bb.fetch2.ParameterError("The number of name and
> > branch parameters is not balanced", ud.url)
> > - ud.cloneflags = "-s -n"
> > + ud.cloneflags = "-n"
> > + if not ud.noshared:
> > + ud.cloneflags += " -s"
> > if ud.bareclone:
> > ud.cloneflags += " --mirror"
> >
>
^ permalink raw reply [flat|nested] 10+ messages in thread
* Re: [PATCH] fetch/git: add support for disabling shared clones on unpack
2017-12-20 16:42 Henning Schild
2017-12-20 16:44 ` Henning Schild
@ 2017-12-20 16:45 ` Henning Schild
2018-01-30 12:18 ` Henning Schild
1 sibling, 1 reply; 10+ messages in thread
From: Henning Schild @ 2017-12-20 16:45 UTC (permalink / raw)
To: bitbake-devel; +Cc: isar-users
We actually ran into that issue on a build system called Isar.
https://github.com/ilbers/isar
This build system executes some tasks in a chroot. In this chroot a
"shared" clone will not work because it expects its "alternate" to be
at the very same location it was outside the chroot. We considered
several hacks in Isar
- patching the alternates before and after chroot
- mounting the "alternate" to the exact location in chroot
None of this is really nice, so we decided to try and do something
about it upstream.
regards,
Henning
Am Wed, 20 Dec 2017 17:42:09 +0100
schrieb Henning Schild <henning.schild@siemens.com>:
> By default the unpacker will create a "shared" clone when cloning from
> the DL_DIR to the WORKDIR. This patch introduces an option to control
> that behaviour. Probably something that hardly anyone would want to
> do.
>
> Imagine some recipe steps are executed in a namespace that is
> different from the one your downloader and unpacker ran in. (chroot)
> Because a "shared" clone has an absolute reference to its "alternate"
> you now have to make that "alternate" visible in that new namespace
> (chroot) at the exact place.
>
> With this patch you can unpack "noshared" and get a stand-alone copy.
> This copy will also work if the "alternate" is not visible or
> existant.
>
> Signed-off-by: Henning Schild <henning.schild@siemens.com>
> ---
> lib/bb/fetch2/git.py | 13 ++++++++++++-
> 1 file changed, 12 insertions(+), 1 deletion(-)
>
> diff --git a/lib/bb/fetch2/git.py b/lib/bb/fetch2/git.py
> index 5ef8cd69..7b7f02b2 100644
> --- a/lib/bb/fetch2/git.py
> +++ b/lib/bb/fetch2/git.py
> @@ -53,6 +53,13 @@ Supported SRC_URI options are:
> For local git:// urls to use the current branch HEAD as the
> revision for use with AUTOREV. Implies nobranch.
>
> +- noshared
> + When unpacking do not clone with the parameter "--shared". This
> option will
> + allow the unpacked copy to work stand-alone i.e. if your recipe
> runs in a
> + chroot where the "alternate" can not be found. Setting this will
> increase
> + the unpack-time and the disk-usage.
> + The default is "0", set noshared=1 if needed.
> +
> """
>
> #Copyright (C) 2005 Richard Purdie
> @@ -159,6 +166,8 @@ class Git(FetchMethod):
>
> ud.nobranch = ud.parm.get("nobranch","0") == "1"
>
> + ud.noshared = ud.parm.get("noshared","0") == "1"
> +
> # usehead implies nobranch
> ud.usehead = ud.parm.get("usehead","0") == "1"
> if ud.usehead:
> @@ -176,7 +185,9 @@ class Git(FetchMethod):
> if len(branches) != len(ud.names):
> raise bb.fetch2.ParameterError("The number of name and
> branch parameters is not balanced", ud.url)
> - ud.cloneflags = "-s -n"
> + ud.cloneflags = "-n"
> + if not ud.noshared:
> + ud.cloneflags += " -s"
> if ud.bareclone:
> ud.cloneflags += " --mirror"
>
^ permalink raw reply [flat|nested] 10+ messages in thread
* Re: [PATCH] fetch/git: add support for disabling shared clones on unpack
2017-12-20 16:42 Henning Schild
@ 2017-12-20 16:44 ` Henning Schild
2017-12-20 16:45 ` Henning Schild
1 sibling, 0 replies; 10+ messages in thread
From: Henning Schild @ 2017-12-20 16:44 UTC (permalink / raw)
Cc: isar-users
Sorry for the noise, but the mailinglist of bitbake is more like
"closedembedded". My messages where never approved and i had to
subscribe ...
Am Wed, 20 Dec 2017 17:42:09 +0100
schrieb Henning Schild <henning.schild@siemens.com>:
> By default the unpacker will create a "shared" clone when cloning from
> the DL_DIR to the WORKDIR. This patch introduces an option to control
> that behaviour. Probably something that hardly anyone would want to
> do.
>
> Imagine some recipe steps are executed in a namespace that is
> different from the one your downloader and unpacker ran in. (chroot)
> Because a "shared" clone has an absolute reference to its "alternate"
> you now have to make that "alternate" visible in that new namespace
> (chroot) at the exact place.
>
> With this patch you can unpack "noshared" and get a stand-alone copy.
> This copy will also work if the "alternate" is not visible or
> existant.
>
> Signed-off-by: Henning Schild <henning.schild@siemens.com>
> ---
> lib/bb/fetch2/git.py | 13 ++++++++++++-
> 1 file changed, 12 insertions(+), 1 deletion(-)
>
> diff --git a/lib/bb/fetch2/git.py b/lib/bb/fetch2/git.py
> index 5ef8cd69..7b7f02b2 100644
> --- a/lib/bb/fetch2/git.py
> +++ b/lib/bb/fetch2/git.py
> @@ -53,6 +53,13 @@ Supported SRC_URI options are:
> For local git:// urls to use the current branch HEAD as the
> revision for use with AUTOREV. Implies nobranch.
>
> +- noshared
> + When unpacking do not clone with the parameter "--shared". This
> option will
> + allow the unpacked copy to work stand-alone i.e. if your recipe
> runs in a
> + chroot where the "alternate" can not be found. Setting this will
> increase
> + the unpack-time and the disk-usage.
> + The default is "0", set noshared=1 if needed.
> +
> """
>
> #Copyright (C) 2005 Richard Purdie
> @@ -159,6 +166,8 @@ class Git(FetchMethod):
>
> ud.nobranch = ud.parm.get("nobranch","0") == "1"
>
> + ud.noshared = ud.parm.get("noshared","0") == "1"
> +
> # usehead implies nobranch
> ud.usehead = ud.parm.get("usehead","0") == "1"
> if ud.usehead:
> @@ -176,7 +185,9 @@ class Git(FetchMethod):
> if len(branches) != len(ud.names):
> raise bb.fetch2.ParameterError("The number of name and
> branch parameters is not balanced", ud.url)
> - ud.cloneflags = "-s -n"
> + ud.cloneflags = "-n"
> + if not ud.noshared:
> + ud.cloneflags += " -s"
> if ud.bareclone:
> ud.cloneflags += " --mirror"
>
^ permalink raw reply [flat|nested] 10+ messages in thread
* [PATCH] fetch/git: add support for disabling shared clones on unpack
@ 2017-12-20 16:42 Henning Schild
2017-12-20 16:44 ` Henning Schild
2017-12-20 16:45 ` Henning Schild
0 siblings, 2 replies; 10+ messages in thread
From: Henning Schild @ 2017-12-20 16:42 UTC (permalink / raw)
To: bitbake-devel; +Cc: isar-users, Henning Schild
By default the unpacker will create a "shared" clone when cloning from
the DL_DIR to the WORKDIR. This patch introduces an option to control
that behaviour. Probably something that hardly anyone would want to do.
Imagine some recipe steps are executed in a namespace that is different
from the one your downloader and unpacker ran in. (chroot) Because a
"shared" clone has an absolute reference to its "alternate" you now
have to make that "alternate" visible in that new namespace (chroot) at
the exact place.
With this patch you can unpack "noshared" and get a stand-alone copy.
This copy will also work if the "alternate" is not visible or existant.
Signed-off-by: Henning Schild <henning.schild@siemens.com>
---
lib/bb/fetch2/git.py | 13 ++++++++++++-
1 file changed, 12 insertions(+), 1 deletion(-)
diff --git a/lib/bb/fetch2/git.py b/lib/bb/fetch2/git.py
index 5ef8cd69..7b7f02b2 100644
--- a/lib/bb/fetch2/git.py
+++ b/lib/bb/fetch2/git.py
@@ -53,6 +53,13 @@ Supported SRC_URI options are:
For local git:// urls to use the current branch HEAD as the revision for use with
AUTOREV. Implies nobranch.
+- noshared
+ When unpacking do not clone with the parameter "--shared". This option will
+ allow the unpacked copy to work stand-alone i.e. if your recipe runs in a
+ chroot where the "alternate" can not be found. Setting this will increase
+ the unpack-time and the disk-usage.
+ The default is "0", set noshared=1 if needed.
+
"""
#Copyright (C) 2005 Richard Purdie
@@ -159,6 +166,8 @@ class Git(FetchMethod):
ud.nobranch = ud.parm.get("nobranch","0") == "1"
+ ud.noshared = ud.parm.get("noshared","0") == "1"
+
# usehead implies nobranch
ud.usehead = ud.parm.get("usehead","0") == "1"
if ud.usehead:
@@ -176,7 +185,9 @@ class Git(FetchMethod):
if len(branches) != len(ud.names):
raise bb.fetch2.ParameterError("The number of name and branch parameters is not balanced", ud.url)
- ud.cloneflags = "-s -n"
+ ud.cloneflags = "-n"
+ if not ud.noshared:
+ ud.cloneflags += " -s"
if ud.bareclone:
ud.cloneflags += " --mirror"
--
2.13.6
^ permalink raw reply [flat|nested] 10+ messages in thread
end of thread, other threads:[~2018-02-12 7:40 UTC | newest]
Thread overview: 10+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2017-12-12 14:44 [PATCH] fetch/git: add support for disabling shared clones on unpack Henning Schild
2017-12-12 14:49 ` Henning Schild
2017-12-12 15:01 ` Henning Schild
2017-12-12 15:12 ` [PATCH v2] " Henning Schild
2018-02-12 7:40 ` Jan Kiszka
2017-12-12 15:14 ` [PATCH] " Henning Schild
2017-12-20 16:42 Henning Schild
2017-12-20 16:44 ` Henning Schild
2017-12-20 16:45 ` Henning Schild
2018-01-30 12:18 ` Henning Schild
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox