- html - 出于某种原因,IE8 对我的 Sass 文件中继承的 html5 CSS 不友好?
- JMeter 在响应断言中使用 span 标签的问题
- html - 在 :hover and :active? 上具有不同效果的 CSS 动画
- html - 相对于居中的 html 内容固定的 CSS 重复背景?
我的代码有问题,我将导出到包含超过 100,000 个数据的 CSV,这里我使用了 chunk
2次,第一次是getData
变量,这里变量取 AssetRepository
另一个类中的函数,另一个是我使用时foreach
,如果我使用 limit
加载 1000 个数据, 数据可以导出。是否可以在不更改 max_execute_time
的情况下加载数据在 php.ini
并且只使用 chunk
?
如果可以,我该如何优化我的代码?
在这种情况下,我使用的是 PostgreSQL。
这是 AssetRepository.php
的代码
class AssetRepository
{
public $query = null;
private $trashed = false;
public static function query()
{
$repo = new AssetRepository();
$repo->query = DB::table('assets as a')
->select(
DB::raw("distinct a.id"),
"a.id",
"a.duration as duration",
DB::raw("COALESCE( NULLIF(a.qr_code,'') , 'QR Code Not Set' ) as qr_code"),
"a.material_no",
DB::raw("COALESCE( NULLIF(a.serial_no,'') , 'Serial No Not Set' ) as serial_no"),
"a.sbu_id",
"a.pop_id",
"a.building_id",
"a.type_id",
"asset_to_sid.cust_id",
"a.category_id",
"a.brand_id",
"a.model_id",
"a.id as id",
"b.name as model",
"b2.name as brand",
"p.name as pop",
"p2.name as sbu",
"q.name as building",
"a.updated_at",
"a.created_at",
"a.deleted_at",
'a.eos',
'a.eol',
"s.name as sts",
"c.name as category",
"a.app_code",
"a.name",
"a.status_approval as status_approval",
"a.approval_notes",
"a.approval_activities",
"a.habis_masa_garansi as habis_masa_garansi",
"permission_approval.action as action_approval",
DB::raw("CONCAT(u.first_name, ' ', u.last_name) as username"),
DB::raw("CONCAT(u2.first_name, ' ', u2.last_name) as username2"),
DB::raw("CONCAT(u3.first_name, ' ', u3.last_name) as approved_by"),
DB::raw("CASE WHEN q2.name is null THEN 'Not Set' ELSE q2.name END as room"),
DB::raw("CASE WHEN cast(a.installation_year as text) is null THEN 'Not Set' ELSE cast(a.installation_year as text) END as installation_year"),
DB::raw("CASE WHEN cast(b.mpls_hierarchy as text) is null THEN 'Not Set' ELSE cast(b.mpls_hierarchy as text) END as mpls_hierarchy"),
DB::raw("CASE WHEN cast(a2.name as text) is null THEN 'Not Set' ELSE cast(a2.name as text) END as rack"),
DB::raw("CASE WHEN cast(a.remark1 as text) is null THEN 'No Data' ELSE cast(a.remark1 as text) END as remark1"),
DB::raw("CASE WHEN cast(a.remark2 as text) is null THEN 'No Data' ELSE cast(a.remark2 as text) END as remark2"),
DB::raw("CASE WHEN cast(a.remark3 as text) is null THEN 'No Data' ELSE cast(a.remark3 as text) END as remark3"),
DB::raw("CASE WHEN cast(a.remark4 as text) is null THEN 'No Data' ELSE cast(a.remark4 as text) END as remark4"),
DB::raw("CASE WHEN cast(a.remark5 as text) is null THEN 'No Data' ELSE cast(a.remark5 as text) END as remark5"),
DB::raw("CASE WHEN cast(a.desc as text) is null THEN 'No Data' ELSE cast(a.desc as text) END as notes"),
DB::raw("CASE WHEN a.c_status = 1 THEN 'Complete' ELSE 'Not Complete' END AS complete"),
DB::raw("CASE WHEN a.c_status = 1 THEN 'btn-primary' ELSE 'btn-warning' END AS btn"),
DB::raw("CASE WHEN p.offline_sts = 1 THEN 'Offline' ELSE 'Online' END AS offline_sts"),
DB::raw("CASE WHEN p.offline_sts = 1 THEN 'btn-default' ELSE 'btn-info' END AS offline_btn"),
DB::raw("CASE WHEN p.offline_sts = 1 THEN 'disabled' ELSE 'enabled' END AS disableds")
)
->leftJoin('assets as a2', 'a.rack', '=', 'a2.id')
->join('kategoris as c', 'a.asset_category', '=', 'c.id')
->join('users as u', 'a.updated_by', 'u.id')
->join('users as u2', 'a.created_by', 'u2.id')
->leftJoin('users as u3', 'a.role_approval', 'u3.id')
->join('sbus as p', 'p.id', '=', 'a.pop_id')
->join('sbus as p2', 'p2.id', '=', 'a.sbu_id')
->leftJoin('pops as q', 'a.building_id', '=', 'q.id')
->leftJoin('pops as q2', 'a.room_id', '=', 'q2.id')
->leftJoin('brands as b', 'a.model_id', '=', 'b.id')
->leftJoin('permission_approval', 'a.permission_approval_id', '=', 'permission_approval.id')
->leftJoin('asset_to_sid', 'a.id', '=', 'asset_to_sid.asset_id')
->join('brands as b2', 'a.brand_id', '=', 'b2.id')
->join('statuses as s', 's.id', '=', 'a.status')
->leftJoin('statuses as ss', 'p.type', '=', 'ss.id')
->orderBy('a.updated_at', 'desc');
return $repo;
}
public function getQuery()
{
return $this->query ?? self::query();
}
public function get()
{
if (!$this->trashed) {
return $this->getQuery()->whereNull('a.deleted_at')->get();
}
return $this->getQuery()->get();
}
}
AssetController.php
public function exportAll(Request $request)
{
$data = AssetRepository::query(); //From AssetRepository Function
$headers = array(
'Content-Type' => 'text/csv',
'Cache-Control' => 'must-revalidate, post-check=0, pre-check=0',
'Content-Disposition' => 'attachment; filename=export.csv',
'Expires' => '0',
'Pragma' => 'public',
);
$response = new StreamedResponse(function () use ($data) {
$handle = fopen('php://output', 'w');
$getData = $data->get();
$remark = Remark::all(['id','label','type']);
$remarkAsset = RemarkAsset::all(['asset_id','value','remark_id']);
$getHeader = array_keys((array)$getData[0]);
$newArray = array();
$setHeader = array();
foreach ($getHeader as $header) {
$setHeader[$header] = $header;
}
$remarkHeader = []; //result
foreach ($remark as $headerRemark) {
$remarkHeader[] = array(
'id' => $headerRemark['id'],
'label' => $headerRemark['label'],
'type' => $headerRemark['type']
);
$setHeader[$headerRemark['type']] = $headerRemark['type'];
}
$remarkAssets = [];
foreach ($remarkAsset as $assetRemark) {
$remarkAssets[] = (array)array(
'asset_id' => $assetRemark['asset_id'],
'value' => $assetRemark['value'],
'remark_id' => $assetRemark['remark_id']
);
}
array_push($newArray, (object)$setHeader);
// $coountData = count($getData) / 4;
$chunk = collect($getData);
$chunk->chunk(500);
foreach ($chunk as $data) {
$theKey=array_keys(array_combine(array_keys($remarkAssets), array_column($remarkAssets, 'asset_id')),$data->id);
foreach ($remarkHeader as $head) {
$countKey = count($theKey);
if ($countKey > 0) {
$valueRemark = '';
foreach ($theKey as $key) {
if ($remarkAssets[$key]['remark_id'] == $head['id']) {
$valueRemark = $remarkAssets[$key]['value'];
}
}
$data = (array)$data;
$data[$head['type']] = $valueRemark;
$data = (object)$data;
} else {
$data = (array)$data;
$data[$head['type']] = '';
$data = (object)$data;
}
}
array_push($newArray, $data);
}
$chunkArray = collect($newArray);
$chunkArray->chunk(500);
foreach ($chunkArray as $datas) {
if (is_object($datas))
$datas = (array)$datas;
fputcsv($handle, $datas);
}
fclose($handle);
}, 200, $headers);
return $response->send();
}
AssetController.php
这是我的代码中使用的查询
最佳答案
您可以调用set_time_limit(0)
从执行的其余部分中删除时间限制,或者您可以调用 set_time_limit(n)
在循环的每次迭代中(例如)将计时器重置 n 秒以上。
https://www.php.net/manual/en/function.set-time-limit.php
关于php - 如何在不更改 php.ini max_execution_time 的情况下避免超过 60 秒的最大执行时间 Laravel,我们在Stack Overflow上找到一个类似的问题: https://stackoverflow.com/questions/59793805/
我是 Java 新手,这是我的代码, if( a.name == b.name && a.displayname == b.displayname && a.linknam
在下面的场景中,我有一个 bool 值。根据结果,我调用完全相同的函数,唯一的区别是参数的数量。 var myBoolean = ... if (myBoolean) { retrieve
我是一名研究 C++ 的 C 开发人员: 我是否正确理解如果我抛出异常然后堆栈将展开直到找到第一个异常处理程序?是否可以在不展开的情况下在任何 throw 上打开调试器(即不离开声明它的范围或任何更高
在修复庞大代码库中的错误时,我观察到一个奇怪的情况,其中引用的动态类型从原始 Derived 类型更改为 Base 类型!我提供了最少的代码来解释问题: struct Base { // some
我正在尝试用 C# 扩展给定的代码,但由于缺乏编程经验,我有点陷入困境。 使用 Visual Studio 社区,我尝试通过控制台读出 CPU 核心温度。该代码使用开关/外壳来查找传感器的特定名称(即
这可能是一个哲学问题。 假设您正在向页面发出 AJAX 请求(这是使用 Prototype): new Ajax.Request('target.asp', { method:"post", pa
我有以下 HTML 代码,我无法在所有浏览器中正常工作: 我试图在移动到
我对 Swift 很陌生。我如何从 addPin 函数中检索注释并能够在我的 addLocation 操作 (buttonPressed) 中使用它。我正在尝试使用压力触摸在 map 上添加图钉,在两
我设置了一个详细 View ,我是否有几个 Nib 文件根据在 Root View Controller 的表中选择的项目来加载。 我发现,对于 Nibs 的类,永远不会调用 viewDidUnloa
我需要动态访问 json 文件并使用以下代码。在本例中,“bpicsel”和“temp”是变量。最终结果类似于“data[0].extit1” var title="data["+bpicsel+"]
我需要使用第三方 WCF 服务。我已经在我的证书存储中配置了所需的证书,但是在调用 WCF 服务时出现以下异常。 向 https://XXXX.com/AHSharedServices/Custome
在几个 SO 答案(1、2)中,建议如果存在冲突则不应触发 INSERT 触发器,ON CONFLICT DO NOTHING 在触发语句中。也许我理解错了,但在我的实验中似乎并非如此。 这是我的 S
如果进行修改,则会给出org.hibernate.NonUniqueObjectException。在我的 BidderBO 类(class)中 @Override @Transactional(pr
我使用 indexOf() 方法来精细地查找数组中的对象。 直到此刻我查了一些资料,发现代码应该无法正常工作。 我在reducer中尝试了上面的代码,它成功了 let tmp = state.find
假设我有以下表格: CREATE TABLE Game ( GameID INT UNSIGNED NOT NULL, GameType TINYINT UNSIGNED NOT NU
代码: Alamofire.request(URL(string: imageUrl)!).downloadProgress(closure: { (progress) in
我是一名优秀的程序员,十分优秀!