Really slow install/run of ExtUtils::Install

I ran into some oddities on ExtUtils::Install (5.8.8 for
cygwin-thread-multi-64int).
One that bothered me the most was how long it took to do some steps.
I ran a script to read each output line and display the time to
see how long the delay(s) were and when they occurred.

Note: This machine is mostly idle -- multiple CPU's and barely any usage
on 1 CPU -- yet something was slowing things down.  Anyone seen anything
like this?  Took about 1.5 minutes to Write the Makefile?
Tests took 13 minutes?  Is this normal?
Delayed areas "*"ed below:

  13:24:36.177000 ExtUtils-Install-1.43/t/lib/TieOut.pm
  13:24:36.223875 ExtUtils-Install-1.43/t/Packlist.t
  13:24:36.270750 ExtUtils-Install-1.43/t/pod-coverage.t
  13:24:36.302000 ExtUtils-Install-1.43/t/pod.t
  13:24:36.348875 CPAN: File::Temp loaded ok (v0.18)
  13:24:36.382125 CPAN: Module::Build loaded ok (v0.2808)
  13:24:36.427000
  13:24:36.473875 CPAN.pm: Going to build Y/YV/YVES/ExtUtils-Install-1.43.tar.gz
   13:24:36.505125
  13:24:36.552000 Checking if your kit is complete...
  13:24:36.598875 Looks good
*13:24:36.645750 Writing Makefile for ExtUtils::Install
  13:26:07.678000 cp lib/ExtUtils/Installed.pm blib/lib/ExtUtils/Installed.pm
  13:26:07.723875 cp lib/ExtUtils/Install.pm blib/lib/ExtUtils/Install.pm
  13:26:07.770750 cp lib/ExtUtils/Packlist.pm blib/lib/ExtUtils/Packlist.pm
  13:26:07.927000 YVES/ExtUtils-Install-1.43.tar.gz
  13:26:07.973875 /usr/bin/make -- OK
  13:26:08.020750 CPAN: YAML loaded ok (v0.65)
  13:26:08.145750 Running make test
*13:26:08.520750 /usr/bin/perl.exe "-Ilib" "-MExtUtils::Command::MM" "-e" "test_harness(0, 'blib/lib', 'blib/arch')" t/*.t
*13:39:00.161375 t/basic...........ok
  13:44:22.067625 t/Install.........ok
  13:44:29.645750 t/Installed.......ok
  13:44:29.895750 t/Packlist........ok
  13:44:30.223875 t/pod-coverage....skipped
  13:44:30.270750 all skipped: Skipping author tests. Set AUTHOR_TESTING=1 to run them.
  13:44:30.770750 t/pod.............ok
  13:44:30.802000 All tests successful, 1 test skipped.
  13:44:30.848875 Files=6, Tests=207, 1102 wallclock secs (27.84 cusr + 21.22 csys = 49.06 CPU)
  13:44:30.895750 YVES/ExtUtils-Install-1.43.tar.gz
  13:44:30.927000 /usr/bin/make test -- OK
*13:44:30.973875 Running make install
  13:45:08.223875 Installing /usr/lib/perl5/5.8/ExtUtils/Install.pm
  13:45:08.255125 Installing /usr/lib/perl5/5.8/ExtUtils/Installed.pm
  13:45:08.302000 Installing /usr/lib/perl5/5.8/ExtUtils/Packlist.pm
  13:45:08.348875 Writing /usr/lib/perl5/5.8/cygwin/auto/ExtUtils/Install/.packlist
  13:45:08.427000 Appending installation info to /usr/lib/perl5/5.8/cygwin/perllocal.pod
  13:45:08.911375 YVES/ExtUtils-Install-1.43.tar.gz
  13:45:08.973875 /usr/bin/make install UNINST=1 -- OK

0
perl
7/26/2007 9:38:15 PM
perl.perl5.porters 48215 articles. 1 followers. Follow

5 Replies
482 Views

Similar Articles

[PageSpeed] 6

Linda W wrote:
> I ran into some oddities on ExtUtils::Install (5.8.8 for
> cygwin-thread-multi-64int).
> One that bothered me the most was how long it took to do some steps.
> I ran a script to read each output line and display the time to
> see how long the delay(s) were and when they occurred.
> 
> Note: This machine is mostly idle -- multiple CPU's and barely any usage
> on 1 CPU -- yet something was slowing things down.  Anyone seen anything
> like this?  Took about 1.5 minutes to Write the Makefile?
> Tests took 13 minutes?  Is this normal?

No, that's not normal.  The whole make and make test process takes 42 seconds
on my Macbook and most of that time is in t/Installed.t.


>  13:24:36.552000 Checking if your kit is complete...
>  13:24:36.598875 Looks good
> *13:24:36.645750 Writing Makefile for ExtUtils::Install
>  13:26:07.678000 cp lib/ExtUtils/Installed.pm
> blib/lib/ExtUtils/Installed.pm

Well that sure shouldn't have taken 90 seconds.  Its running the Makefile and
that generally means running a lot of processes and in particular a lot of
perl one-liners.


>  13:26:07.723875 cp lib/ExtUtils/Install.pm blib/lib/ExtUtils/Install.pm
>  13:26:07.770750 cp lib/ExtUtils/Packlist.pm blib/lib/ExtUtils/Packlist.pm
>  13:26:07.927000 YVES/ExtUtils-Install-1.43.tar.gz
>  13:26:07.973875 /usr/bin/make -- OK
>  13:26:08.020750 CPAN: YAML loaded ok (v0.65)
>  13:26:08.145750 Running make test
> *13:26:08.520750 /usr/bin/perl.exe "-Ilib" "-MExtUtils::Command::MM"
> "-e" "test_harness(0, 'blib/lib', 'blib/arch')" t/*.t
> *13:39:00.161375 t/basic...........ok
>  13:44:22.067625 t/Install.........ok

basic.t is doing a lot of shell calls to run make, so it can be slow but 5
minutes is excessive.


> *13:44:30.973875 Running make install
>  13:45:08.223875 Installing /usr/lib/perl5/5.8/ExtUtils/Install.pm

That's also pretty excessive, its also doing a lot of firing up separate perl
one-liners.


What it smells like is that starting a perl process is excessively slow for
you.  I'd try doing some profiling at that level or digging around to see if
Cygwin is having trouble with that.
0
schwern
7/27/2007 12:28:20 AM
In the case of Installed the problem is probably because Installed will 
do a complete File::Find scan of your entire lib directories, in order 
to try and locate all installed modules.

If you have a lot of modules and/or slow IO (networked, virtualised, 
etc) this could take a very long time.

Adam K

Michael G Schwern wrote:
> Linda W wrote:
>> I ran into some oddities on ExtUtils::Install (5.8.8 for
>> cygwin-thread-multi-64int).
>> One that bothered me the most was how long it took to do some steps.
>> I ran a script to read each output line and display the time to
>> see how long the delay(s) were and when they occurred.
>>
>> Note: This machine is mostly idle -- multiple CPU's and barely any usage
>> on 1 CPU -- yet something was slowing things down.  Anyone seen anything
>> like this?  Took about 1.5 minutes to Write the Makefile?
>> Tests took 13 minutes?  Is this normal?
> 
> No, that's not normal.  The whole make and make test process takes 42 seconds
> on my Macbook and most of that time is in t/Installed.t.
> 
> 
>>  13:24:36.552000 Checking if your kit is complete...
>>  13:24:36.598875 Looks good
>> *13:24:36.645750 Writing Makefile for ExtUtils::Install
>>  13:26:07.678000 cp lib/ExtUtils/Installed.pm
>> blib/lib/ExtUtils/Installed.pm
> 
> Well that sure shouldn't have taken 90 seconds.  Its running the Makefile and
> that generally means running a lot of processes and in particular a lot of
> perl one-liners.
> 
> 
>>  13:26:07.723875 cp lib/ExtUtils/Install.pm blib/lib/ExtUtils/Install.pm
>>  13:26:07.770750 cp lib/ExtUtils/Packlist.pm blib/lib/ExtUtils/Packlist.pm
>>  13:26:07.927000 YVES/ExtUtils-Install-1.43.tar.gz
>>  13:26:07.973875 /usr/bin/make -- OK
>>  13:26:08.020750 CPAN: YAML loaded ok (v0.65)
>>  13:26:08.145750 Running make test
>> *13:26:08.520750 /usr/bin/perl.exe "-Ilib" "-MExtUtils::Command::MM"
>> "-e" "test_harness(0, 'blib/lib', 'blib/arch')" t/*.t
>> *13:39:00.161375 t/basic...........ok
>>  13:44:22.067625 t/Install.........ok
> 
> basic.t is doing a lot of shell calls to run make, so it can be slow but 5
> minutes is excessive.
> 
> 
>> *13:44:30.973875 Running make install
>>  13:45:08.223875 Installing /usr/lib/perl5/5.8/ExtUtils/Install.pm
> 
> That's also pretty excessive, its also doing a lot of firing up separate perl
> one-liners.
> 
> 
> What it smells like is that starting a perl process is excessively slow for
> you.  I'd try doing some profiling at that level or digging around to see if
> Cygwin is having trouble with that.

0
adamk
7/27/2007 5:03:36 AM
On Thu, 2007-07-26 at 17:28 -0700, Michael G Schwern wrote:

> What it smells like is that starting a perl process is excessively slow for
> you.  I'd try doing some profiling at that level or digging around to see if
> Cygwin is having trouble with that.

Starting a process on Cygwin always seems slower ....
0
jns
7/27/2007 7:42:38 AM
>   13:44:30.848875 Files=6, Tests=207, 1102 wallclock secs (27.84 cusr + 21.22 csys = 49.06 CPU)

FWIW, 'make test' for me using bleadperl under Cygwin
produce:

Files=6, Tests=207, 68 wallclock secs (23.93 cusr + 18.62 csys = 42.55 CPU)

Note that the CPU time is about the same, but the wallclock
times differ by a factor of 20.  To me, this suggests
something other than code or Cygwin is at issue.

> Note: This machine is mostly idle -- multiple CPU's and
> barely any usage on 1 CPU -- yet something was slowing
> things down.

Then perhaps it is something abnormal related to I/O.
0
jdhedden
7/27/2007 12:25:07 PM
Jerry D. Hedden schrieb:
>>   13:44:30.848875 Files=6, Tests=207, 1102 wallclock secs (27.84 cusr + 21.22 csys = 49.06 CPU)
> FWIW, 'make test' for me using bleadperl under Cygwin
> produce:
> 
> Files=6, Tests=207, 68 wallclock secs (23.93 cusr + 18.62 csys = 42.55 CPU)
> 
> Note that the CPU time is about the same, but the wallclock
> times differ by a factor of 20.  To me, this suggests
> something other than code or Cygwin is at issue.
> 
>> Note: This machine is mostly idle -- multiple CPU's and
>> barely any usage on 1 CPU -- yet something was slowing
>> things down.
> 
> Then perhaps it is something abnormal related to I/O.

Usually:
http://cygwin.com/faq/faq.using.html#faq.using.slow
(network shares in path) or a filesystem onaccess hook (antivir).

http://www.cygwin.com/faq/faq.using.html#faq.using.anti-virus
http://www.cygwin.com/faq/faq.using.html#faq.using.firewall
-- 
Reini
0
rurban
7/28/2007 11:17:13 AM
Reply:

Similar Artilces:

To install or not to install?
What's the difference between installing qpsmtpd as in...=0A=0Aperl Makefil= e.PL=0Amake=0Amake test=0Amake install=0Amake clean=0A=0A... or running it = directly from /home/smtpd/qpsmtpd?=0A=0APresently I'm running ./qpsmtpd fro= m xinetd, so the installed copy is probably wasted, right?=0A=0AIs there an= y benefit/downside in running an installed copy, and how would I do that?= =0A=0AHans=0A=0A=0A There is no benefit to installing. I've been running under xinetd for a couple of years, directly from an svn checkout in /var/qpsmtpd. In fact, I dont even make changes ...

[PATCH ExtUtils/Installed.pm ExtUtils/t/Installed.t]
I posted patches to Alan for Installed.pm but he has not had time to look at them. As Installed.t is moving all the time, I thought it was best to post the patches for all to see. I don't think Installed.pm/Installed.t should use install... variables, they should use ...exp instead (accorrding to Porting/Glossary) I have changed the variables and corrected some doc typos in Installed.pm I have made the corresponding changes to Installed.t and changed the skippings so more tests are run if only one of man1dir/man3dir is none. Patches against perl@14647 Robin --- perl_1...

[PATCH MANIFEST, lib/ExtUtils/Installed.t] Add tests for ExtUtils::Installed
This passes all tests, gets the MANIFEST patch right for once, and shouldn't have weird sorting bugs on EBCDIC platforms. Cross your fingers. -- c --- ~MANIFEST Sat Dec 15 23:17:25 2001 +++ MANIFEST Sat Dec 15 23:17:42 2001 @@ -906,6 +906,7 @@ lib/ExtUtils/inst Give information about installed extensions lib/ExtUtils/Install.pm Handles 'make install' on extensions lib/ExtUtils/Installed.pm Information on installed extensions +lib/ExtUtils/Installed.t See if ExtUtils::Installed works lib/ExtUtils/Liblist.pm Locates libraries lib/ExtUtils/MakeMaker.pm Write Ma...

Should I Save it and then Install or Run to install straightaway?
Name: Maureen Pritchett Email: firefox_at_cambridgetelenet.co.uk Product: Firefox Summary: Should I Save it and then Install or Run to install straightaway? Comments: I clicked on Download (Firefox 2) and was asked whether I wanted to Run the installation or Save it to Disc and then run the installation. What are the pros and cons of each please? Which gives the most troublefree installation? Browser Details: Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 1.1.4322; .NET CLR 2.0.50727) Maureen Pritchett wrote: > Name: Maureen Pritchett > Email: ...

ExtUtils-Install/t/Install.t
Hi Chris, you pushed this just now: commit 84d7dacc0cf1fae82700fa22ee4991accd0a084e Skip writable tests in ExtUtils-Install when root ... - ok( !-w "$bigdir/DummyHard.pm", 'DummyHard.pm not writeable' ); + SKIP: { + skip 'everywhere is writable to root', 1 if $> == 0; + ok( !-w "$bigdir/DummyHard.pm", 'DummyHard.pm not writeable' ); + } At almost the same time that I was about to push my own fix: +# do a -w style test, but based on just on file perms rather than UID ...

install netware components not installed in the 1st installation
I have a NW5.1 running file services and NW5.0 running GW3.6. Both servers are installed in the same tree. I now wish to install Netware components like Portal, HTTP, NTTP etc one my NW5.1 server. I have SP6 installed on my NW5.1 What is the correct procedure I should adopt to successfully install these components? Thanks, Martin. On Wed, 11 Aug 2004 09:00:46 GMT, martin.scicluna@deltamalta.com wrote: >What is the correct procedure I should adopt to successfully install these >components? Use the console GUI Install, and select the products you want to inst...

Should I Save it and then Install or Run to install straightaway? #2
Name: Maureen Pritchett Email: firefox_at_cambridgetelenet.co.uk Product: Firefox Summary: Should I Save it and then Install or Run to install straightaway? Comments: I clicked on Download (Firefox 2) and was asked whether I wanted to Run the installation or Save it to Disc and then run the installation. What are the pros and cons of each please? Which gives the most troublefree installation? Browser Details: Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 1.1.4322; .NET CLR 2.0.50727) Maureen Pritchett wrote: > Name: Maureen Pritchett > Email: ...

ACU Installation Error ...installation is already running...
When attempting to upgrade the Novell Client on Windows Vista systems, the installation stops with the attached error message: "Installation Error: The Novell Client Installation is already running on this Windows machine. Please complete and close the existing Novell Client Installation program before attempting to run SETUP.EXE again.." Prior to the install, the system was restarted, no instances of setup.exe. Monitoring task manager shows that ACU will attempt to start two instances of setup.exe. We have multiple systems which yield the same error so it is not a &...

no install after installing jvm141
i have waited for a few days now to see if anyone would reply to my last response and got nothing so far so i figured i would repost everything in hopes that someone woudl be able to help me, please read below. ============================ In article , wrote: > i cant find the install opption on the GUI to install imanager. i just > updated to the newest jvm and the gui looks totally differnet, and the > start options all changed. any ideas? > What exact NetWare version are you using (including SP)? In theory, you should use the "install" option in ...

Is there a Gzip installer that I could install ?
Trying to make things easier I have a question about the linux desktop interface .. is direct package installed that I could use opening it on files using the right click method from windows ? "open with" / "chosen freeware" = click ! -- Cypher7 ------------------------------------------------------------------------ Cypher7 wrote: > > Trying to make things easier I have a question about the linux desktop > interface The linux desktop interface can be a lot of things, KDE,GNOME, windowmaker to name but a few. > .. is direct packa...

[PATCH] Make Extutils::Installed capable of examining other installations
--------------090602080706000308070209 Content-Type: text/plain; charset=ISO-8859-15; format=flowed Content-Transfer-Encoding: 7bit Hi Yves, hi p5p, the attached patch makes ExtUtils::Installed capable of examining perl installations other than the currently running one. It does so by adding two optional, named parameters to the new() method which point at a hash of overrides for the %Config data and an array of overrides for @INC. Tests included. The use case for this is that a PAR packaged perl maintenance utility should be able to do maintenance not on the packager's...

Installation and system really slow
Hi everyone, I've some problem with openSUSE 64bits and more precisely extreme slowness. At first, it was during the Installation (net install), each action (click on a button for example) was followed by a global freeze (though mouse was not). The entire configuration (the first part of installation) took me about 1 hour... At that time, i was thinking "ok it's just installation, it will be fast and smooth in the end..." I was wrong, the system is as slow as the installation but weird thing: it's only when I log on that the system slow down. I mean the b...

Installing software REALLY slow
When I open a program to install software, it seems to take a half hour to configure repos and another half hour to install what I select. If the system is checking for updates, I can forget about installing software for the rest of the evening, because Yast will ask kPackageKit to shut down, but kPackageKit will not comply. Is that normal? For instance, as I write this, the auto updater has been Refreshing Package Cache for over an hour and a half. I've tried with a lean list of repos, whch doesn't speed things up by much, but adds time to reconfigure the repos if I need ...

Installed 11.1 and runing very slow after new install
I just installed 11.1. After the fresh install my pc it is running very slow. It takes a good amount of time to load web pages in the browser. When I run my mail client, Thunderbird, the display comes up clouded as if x-windows is having a problem painting the screen. When dragging a window you can see the display lag. The general performance is poor. I was running 10.2 on this same pc before the fresh install of 11.1, and it ran like a champ, very fast. I opened a root window an ran top and I am not seeing anything that jumps out as a problem. The PC is a P4 2.8ghz, 2gb me...

Web resources about - Really slow install/run of ExtUtils::Install - perl.perl5.porters

Resources last updated: 12/16/2015 9:45:13 AM